2023-07-18 18:10:10,250 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-18 18:10:10,508 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155 2023-07-18 18:10:10,509 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-18 18:10:10,509 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-18 18:10:10,554 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-18 18:10:10,814 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-18 18:10:10,814 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71, deleteOnExit=true 2023-07-18 18:10:10,815 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-18 18:10:10,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/test.cache.data in system properties and HBase conf 2023-07-18 18:10:10,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 18:10:10,817 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/hadoop.log.dir in system properties and HBase conf 2023-07-18 18:10:10,817 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 18:10:10,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 18:10:10,818 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 18:10:11,147 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-18 18:10:11,153 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:10:11,154 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:10:11,154 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 18:10:11,155 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:10:11,155 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 18:10:11,156 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 18:10:11,156 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:10:11,156 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:10:11,157 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 18:10:11,157 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/nfs.dump.dir in system properties and HBase conf 2023-07-18 18:10:11,158 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/java.io.tmpdir in system properties and HBase conf 2023-07-18 18:10:11,158 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:10:11,159 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 18:10:11,159 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-18 18:10:11,802 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 18:10:11,806 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 18:10:12,109 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-18 18:10:12,269 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-18 18:10:12,287 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:12,334 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:12,370 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/java.io.tmpdir/Jetty_localhost_38321_hdfs____byvzyv/webapp 2023-07-18 18:10:12,519 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38321 2023-07-18 18:10:12,551 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 18:10:12,552 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 18:10:13,050 WARN [Listener at localhost/35301] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:10:13,152 WARN [Listener at localhost/35301] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:10:13,181 WARN [Listener at localhost/35301] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:13,190 INFO [Listener at localhost/35301] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:13,197 INFO [Listener at localhost/35301] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/java.io.tmpdir/Jetty_localhost_44009_datanode____6q54ps/webapp 2023-07-18 18:10:13,329 INFO [Listener at localhost/35301] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44009 2023-07-18 18:10:13,900 WARN [Listener at localhost/38263] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:10:13,945 WARN [Listener at localhost/38263] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:10:13,949 WARN [Listener at localhost/38263] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:13,950 INFO [Listener at localhost/38263] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:13,961 INFO [Listener at localhost/38263] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/java.io.tmpdir/Jetty_localhost_42671_datanode____bfohmh/webapp 2023-07-18 18:10:14,101 INFO [Listener at localhost/38263] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42671 2023-07-18 18:10:14,128 WARN [Listener at localhost/44773] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:10:14,185 WARN [Listener at localhost/44773] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:10:14,191 WARN [Listener at localhost/44773] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:14,193 INFO [Listener at localhost/44773] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:14,205 INFO [Listener at localhost/44773] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/java.io.tmpdir/Jetty_localhost_36963_datanode____sqf2sa/webapp 2023-07-18 18:10:14,345 INFO [Listener at localhost/44773] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36963 2023-07-18 18:10:14,401 WARN [Listener at localhost/39415] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:10:14,640 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x924385f27343caa: Processing first storage report for DS-799da818-4ec1-4585-9e58-cbfdb52954bd from datanode 6ca67228-b883-4273-88fd-21ed7af7fb89 2023-07-18 18:10:14,643 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x924385f27343caa: from storage DS-799da818-4ec1-4585-9e58-cbfdb52954bd node DatanodeRegistration(127.0.0.1:35751, datanodeUuid=6ca67228-b883-4273-88fd-21ed7af7fb89, infoPort=39301, infoSecurePort=0, ipcPort=44773, storageInfo=lv=-57;cid=testClusterID;nsid=2125542389;c=1689703811876), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-18 18:10:14,643 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc58011d4489815f3: Processing first storage report for DS-548b8df7-568a-4bac-86d5-6c90c28d081d from datanode a1863efc-37b3-472c-85a1-414a1e1d2fe2 2023-07-18 18:10:14,643 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc58011d4489815f3: from storage DS-548b8df7-568a-4bac-86d5-6c90c28d081d node DatanodeRegistration(127.0.0.1:42171, datanodeUuid=a1863efc-37b3-472c-85a1-414a1e1d2fe2, infoPort=40673, infoSecurePort=0, ipcPort=38263, storageInfo=lv=-57;cid=testClusterID;nsid=2125542389;c=1689703811876), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:10:14,643 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x924385f27343caa: Processing first storage report for DS-72f3a2a6-7bd7-401a-85f3-f55e2022a458 from datanode 6ca67228-b883-4273-88fd-21ed7af7fb89 2023-07-18 18:10:14,644 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x924385f27343caa: from storage DS-72f3a2a6-7bd7-401a-85f3-f55e2022a458 node DatanodeRegistration(127.0.0.1:35751, datanodeUuid=6ca67228-b883-4273-88fd-21ed7af7fb89, infoPort=39301, infoSecurePort=0, ipcPort=44773, storageInfo=lv=-57;cid=testClusterID;nsid=2125542389;c=1689703811876), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-18 18:10:14,644 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc58011d4489815f3: Processing first storage report for DS-201b4d9e-8a85-44d4-8ee2-91c7edfcfd5f from datanode a1863efc-37b3-472c-85a1-414a1e1d2fe2 2023-07-18 18:10:14,644 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc58011d4489815f3: from storage DS-201b4d9e-8a85-44d4-8ee2-91c7edfcfd5f node DatanodeRegistration(127.0.0.1:42171, datanodeUuid=a1863efc-37b3-472c-85a1-414a1e1d2fe2, infoPort=40673, infoSecurePort=0, ipcPort=38263, storageInfo=lv=-57;cid=testClusterID;nsid=2125542389;c=1689703811876), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:10:14,654 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcffbc048b73b5fe2: Processing first storage report for DS-c0e532a9-9d82-4054-a2fb-a97a061289fb from datanode 69cb99d1-e83a-4e5a-94e8-d85b6528869e 2023-07-18 18:10:14,655 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcffbc048b73b5fe2: from storage DS-c0e532a9-9d82-4054-a2fb-a97a061289fb node DatanodeRegistration(127.0.0.1:35181, datanodeUuid=69cb99d1-e83a-4e5a-94e8-d85b6528869e, infoPort=37113, infoSecurePort=0, ipcPort=39415, storageInfo=lv=-57;cid=testClusterID;nsid=2125542389;c=1689703811876), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-18 18:10:14,655 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcffbc048b73b5fe2: Processing first storage report for DS-823eb6ed-8179-43d8-b801-d0e245736cd4 from datanode 69cb99d1-e83a-4e5a-94e8-d85b6528869e 2023-07-18 18:10:14,655 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcffbc048b73b5fe2: from storage DS-823eb6ed-8179-43d8-b801-d0e245736cd4 node DatanodeRegistration(127.0.0.1:35181, datanodeUuid=69cb99d1-e83a-4e5a-94e8-d85b6528869e, infoPort=37113, infoSecurePort=0, ipcPort=39415, storageInfo=lv=-57;cid=testClusterID;nsid=2125542389;c=1689703811876), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:10:14,904 DEBUG [Listener at localhost/39415] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155 2023-07-18 18:10:14,988 INFO [Listener at localhost/39415] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/zookeeper_0, clientPort=57608, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-18 18:10:15,009 INFO [Listener at localhost/39415] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57608 2023-07-18 18:10:15,021 INFO [Listener at localhost/39415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:15,024 INFO [Listener at localhost/39415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:15,731 INFO [Listener at localhost/39415] util.FSUtils(471): Created version file at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 with version=8 2023-07-18 18:10:15,731 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/hbase-staging 2023-07-18 18:10:16,072 INFO [Listener at localhost/39415] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-18 18:10:16,589 INFO [Listener at localhost/39415] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:10:16,659 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:16,660 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:16,660 INFO [Listener at localhost/39415] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:10:16,661 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:16,661 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:10:16,840 INFO [Listener at localhost/39415] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:10:16,945 DEBUG [Listener at localhost/39415] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-18 18:10:17,073 INFO [Listener at localhost/39415] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40369 2023-07-18 18:10:17,090 INFO [Listener at localhost/39415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,092 INFO [Listener at localhost/39415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,117 INFO [Listener at localhost/39415] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40369 connecting to ZooKeeper ensemble=127.0.0.1:57608 2023-07-18 18:10:17,173 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:403690x0, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:10:17,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40369-0x10179a09a370000 connected 2023-07-18 18:10:17,211 DEBUG [Listener at localhost/39415] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:10:17,212 DEBUG [Listener at localhost/39415] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:10:17,227 DEBUG [Listener at localhost/39415] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:10:17,237 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40369 2023-07-18 18:10:17,237 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40369 2023-07-18 18:10:17,242 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40369 2023-07-18 18:10:17,245 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40369 2023-07-18 18:10:17,245 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40369 2023-07-18 18:10:17,253 INFO [Listener at localhost/39415] master.HMaster(444): hbase.rootdir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9, hbase.cluster.distributed=false 2023-07-18 18:10:17,323 INFO [Listener at localhost/39415] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:10:17,324 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,324 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,324 INFO [Listener at localhost/39415] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:10:17,324 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,325 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:10:17,330 INFO [Listener at localhost/39415] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:10:17,333 INFO [Listener at localhost/39415] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34171 2023-07-18 18:10:17,336 INFO [Listener at localhost/39415] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:10:17,344 INFO [Listener at localhost/39415] mob.MobFileCache(124): MobFileCache disabled 2023-07-18 18:10:17,345 INFO [Listener at localhost/39415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,348 INFO [Listener at localhost/39415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,350 INFO [Listener at localhost/39415] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34171 connecting to ZooKeeper ensemble=127.0.0.1:57608 2023-07-18 18:10:17,356 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:341710x0, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:10:17,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34171-0x10179a09a370001 connected 2023-07-18 18:10:17,360 DEBUG [Listener at localhost/39415] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:10:17,362 DEBUG [Listener at localhost/39415] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:10:17,363 DEBUG [Listener at localhost/39415] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:10:17,366 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34171 2023-07-18 18:10:17,366 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34171 2023-07-18 18:10:17,367 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34171 2023-07-18 18:10:17,370 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34171 2023-07-18 18:10:17,373 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34171 2023-07-18 18:10:17,387 INFO [Listener at localhost/39415] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:10:17,387 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,387 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,388 INFO [Listener at localhost/39415] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:10:17,388 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,389 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:10:17,389 INFO [Listener at localhost/39415] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:10:17,399 INFO [Listener at localhost/39415] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40677 2023-07-18 18:10:17,400 INFO [Listener at localhost/39415] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:10:17,409 INFO [Listener at localhost/39415] mob.MobFileCache(124): MobFileCache disabled 2023-07-18 18:10:17,409 INFO [Listener at localhost/39415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,413 INFO [Listener at localhost/39415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,416 INFO [Listener at localhost/39415] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40677 connecting to ZooKeeper ensemble=127.0.0.1:57608 2023-07-18 18:10:17,535 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:406770x0, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:10:17,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40677-0x10179a09a370002 connected 2023-07-18 18:10:17,537 DEBUG [Listener at localhost/39415] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:10:17,538 DEBUG [Listener at localhost/39415] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:10:17,539 DEBUG [Listener at localhost/39415] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:10:17,540 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40677 2023-07-18 18:10:17,540 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40677 2023-07-18 18:10:17,541 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40677 2023-07-18 18:10:17,541 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40677 2023-07-18 18:10:17,542 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40677 2023-07-18 18:10:17,555 INFO [Listener at localhost/39415] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:10:17,555 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,556 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,556 INFO [Listener at localhost/39415] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:10:17,556 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,556 INFO [Listener at localhost/39415] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:10:17,556 INFO [Listener at localhost/39415] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:10:17,558 INFO [Listener at localhost/39415] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39949 2023-07-18 18:10:17,560 INFO [Listener at localhost/39415] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:10:17,563 INFO [Listener at localhost/39415] mob.MobFileCache(124): MobFileCache disabled 2023-07-18 18:10:17,564 INFO [Listener at localhost/39415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,565 INFO [Listener at localhost/39415] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,567 INFO [Listener at localhost/39415] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39949 connecting to ZooKeeper ensemble=127.0.0.1:57608 2023-07-18 18:10:17,673 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:399490x0, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:10:17,675 DEBUG [Listener at localhost/39415] zookeeper.ZKUtil(164): regionserver:399490x0, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:10:17,676 DEBUG [Listener at localhost/39415] zookeeper.ZKUtil(164): regionserver:399490x0, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:10:17,677 DEBUG [Listener at localhost/39415] zookeeper.ZKUtil(164): regionserver:399490x0, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:10:17,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39949-0x10179a09a370003 connected 2023-07-18 18:10:17,679 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39949 2023-07-18 18:10:17,680 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39949 2023-07-18 18:10:17,680 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39949 2023-07-18 18:10:17,686 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39949 2023-07-18 18:10:17,687 DEBUG [Listener at localhost/39415] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39949 2023-07-18 18:10:17,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40369,1689703815902 2023-07-18 18:10:17,797 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 18:10:17,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40369,1689703815902 2023-07-18 18:10:17,935 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:10:17,935 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:10:17,935 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:10:17,936 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:10:17,936 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:17,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 18:10:17,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40369,1689703815902 from backup master directory 2023-07-18 18:10:17,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 18:10:18,027 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40369,1689703815902 2023-07-18 18:10:18,027 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 18:10:18,028 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:10:18,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40369,1689703815902 2023-07-18 18:10:18,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-18 18:10:18,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-18 18:10:18,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/hbase.id with ID: 9db843fa-eec7-4529-bac1-44d26fcb4aad 2023-07-18 18:10:18,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:18,250 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:18,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x53dd3f70 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:18,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c40050, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:18,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:10:18,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-18 18:10:18,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-18 18:10:18,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-18 18:10:18,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 18:10:18,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 18:10:18,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:10:18,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/data/master/store-tmp 2023-07-18 18:10:18,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:18,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 18:10:18,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:10:18,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:10:18,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 18:10:18,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:10:18,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:10:18,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:10:18,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/WALs/jenkins-hbase4.apache.org,40369,1689703815902 2023-07-18 18:10:18,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40369%2C1689703815902, suffix=, logDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/WALs/jenkins-hbase4.apache.org,40369,1689703815902, archiveDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/oldWALs, maxLogs=10 2023-07-18 18:10:18,727 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35751,DS-799da818-4ec1-4585-9e58-cbfdb52954bd,DISK] 2023-07-18 18:10:18,727 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42171,DS-548b8df7-568a-4bac-86d5-6c90c28d081d,DISK] 2023-07-18 18:10:18,727 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35181,DS-c0e532a9-9d82-4054-a2fb-a97a061289fb,DISK] 2023-07-18 18:10:18,736 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-18 18:10:18,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/WALs/jenkins-hbase4.apache.org,40369,1689703815902/jenkins-hbase4.apache.org%2C40369%2C1689703815902.1689703818671 2023-07-18 18:10:18,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35751,DS-799da818-4ec1-4585-9e58-cbfdb52954bd,DISK], DatanodeInfoWithStorage[127.0.0.1:42171,DS-548b8df7-568a-4bac-86d5-6c90c28d081d,DISK], DatanodeInfoWithStorage[127.0.0.1:35181,DS-c0e532a9-9d82-4054-a2fb-a97a061289fb,DISK]] 2023-07-18 18:10:18,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:10:18,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:18,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:10:18,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:10:18,926 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:10:18,934 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-18 18:10:18,967 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-18 18:10:18,981 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:18,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:10:18,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:10:19,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:10:19,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:19,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69721163, jitterRate=0.03892628848552704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:19,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:10:19,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-18 18:10:19,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-18 18:10:19,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-18 18:10:19,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-18 18:10:19,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-18 18:10:19,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 53 msec 2023-07-18 18:10:19,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-18 18:10:19,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-18 18:10:19,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-18 18:10:19,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 18:10:19,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 18:10:19,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-18 18:10:19,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-18 18:10:19,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-18 18:10:19,242 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:19,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-18 18:10:19,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-18 18:10:19,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-18 18:10:19,274 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:10:19,275 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:10:19,275 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:10:19,275 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:10:19,275 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:19,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40369,1689703815902, sessionid=0x10179a09a370000, setting cluster-up flag (Was=false) 2023-07-18 18:10:19,310 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:19,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-18 18:10:19,319 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40369,1689703815902 2023-07-18 18:10:19,328 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:19,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-18 18:10:19,339 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40369,1689703815902 2023-07-18 18:10:19,342 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp 2023-07-18 18:10:19,393 INFO [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(951): ClusterId : 9db843fa-eec7-4529-bac1-44d26fcb4aad 2023-07-18 18:10:19,398 INFO [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(951): ClusterId : 9db843fa-eec7-4529-bac1-44d26fcb4aad 2023-07-18 18:10:19,399 INFO [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(951): ClusterId : 9db843fa-eec7-4529-bac1-44d26fcb4aad 2023-07-18 18:10:19,405 DEBUG [RS:2;jenkins-hbase4:39949] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:10:19,405 DEBUG [RS:0;jenkins-hbase4:34171] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:10:19,405 DEBUG [RS:1;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:10:19,438 DEBUG [RS:2;jenkins-hbase4:39949] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:10:19,438 DEBUG [RS:0;jenkins-hbase4:34171] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:10:19,439 DEBUG [RS:0;jenkins-hbase4:34171] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:10:19,439 DEBUG [RS:2;jenkins-hbase4:39949] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:10:19,439 DEBUG [RS:1;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:10:19,439 DEBUG [RS:1;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:10:19,444 DEBUG [RS:0;jenkins-hbase4:34171] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:10:19,450 DEBUG [RS:0;jenkins-hbase4:34171] zookeeper.ReadOnlyZKClient(139): Connect 0x5389828c to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:19,455 DEBUG [RS:2;jenkins-hbase4:39949] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:10:19,456 DEBUG [RS:2;jenkins-hbase4:39949] zookeeper.ReadOnlyZKClient(139): Connect 0x327fa770 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:19,459 DEBUG [RS:1;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:10:19,468 DEBUG [RS:1;jenkins-hbase4:40677] zookeeper.ReadOnlyZKClient(139): Connect 0x255f7fab to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:19,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-18 18:10:19,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:19,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-18 18:10:19,513 DEBUG [RS:0;jenkins-hbase4:34171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ceed1a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:19,515 DEBUG [RS:0;jenkins-hbase4:34171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38d008a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:10:19,534 DEBUG [RS:1;jenkins-hbase4:40677] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@605df564, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:19,534 DEBUG [RS:2;jenkins-hbase4:39949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66d5afcb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:19,534 DEBUG [RS:1;jenkins-hbase4:40677] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77cb3478, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:10:19,535 DEBUG [RS:2;jenkins-hbase4:39949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66f01335, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:10:19,552 DEBUG [RS:2;jenkins-hbase4:39949] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:39949 2023-07-18 18:10:19,552 DEBUG [RS:1;jenkins-hbase4:40677] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40677 2023-07-18 18:10:19,552 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34171 2023-07-18 18:10:19,564 INFO [RS:2;jenkins-hbase4:39949] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:10:19,564 INFO [RS:2;jenkins-hbase4:39949] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:10:19,565 DEBUG [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 18:10:19,569 INFO [RS:0;jenkins-hbase4:34171] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:10:19,571 INFO [RS:0;jenkins-hbase4:34171] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:10:19,572 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 18:10:19,572 INFO [RS:0;jenkins-hbase4:34171] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:19,572 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:10:19,576 INFO [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40369,1689703815902 with isa=jenkins-hbase4.apache.org/172.31.14.131:34171, startcode=1689703817322 2023-07-18 18:10:19,569 INFO [RS:1;jenkins-hbase4:40677] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:10:19,578 INFO [RS:1;jenkins-hbase4:40677] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:10:19,570 INFO [RS:2;jenkins-hbase4:39949] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:19,578 DEBUG [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:10:19,578 DEBUG [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 18:10:19,579 INFO [RS:1;jenkins-hbase4:40677] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:19,579 DEBUG [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:10:19,579 INFO [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40369,1689703815902 with isa=jenkins-hbase4.apache.org/172.31.14.131:39949, startcode=1689703817554 2023-07-18 18:10:19,580 INFO [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40369,1689703815902 with isa=jenkins-hbase4.apache.org/172.31.14.131:40677, startcode=1689703817386 2023-07-18 18:10:19,603 DEBUG [RS:1;jenkins-hbase4:40677] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:10:19,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-18 18:10:19,603 DEBUG [RS:2;jenkins-hbase4:39949] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:10:19,603 DEBUG [RS:0;jenkins-hbase4:34171] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:10:19,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:10:19,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:10:19,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:10:19,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:10:19,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-18 18:10:19,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:19,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:10:19,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:19,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689703849676 2023-07-18 18:10:19,681 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 18:10:19,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-18 18:10:19,682 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-18 18:10:19,688 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 18:10:19,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-18 18:10:19,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-18 18:10:19,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-18 18:10:19,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-18 18:10:19,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-18 18:10:19,709 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55241, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:10:19,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:19,709 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59241, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:10:19,709 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49435, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:10:19,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-18 18:10:19,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-18 18:10:19,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-18 18:10:19,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-18 18:10:19,728 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40369] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:10:19,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-18 18:10:19,739 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40369] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:10:19,740 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40369] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:10:19,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689703819731,5,FailOnTimeoutGroup] 2023-07-18 18:10:19,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689703819741,5,FailOnTimeoutGroup] 2023-07-18 18:10:19,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:19,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-18 18:10:19,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:19,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:19,817 DEBUG [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 18:10:19,817 WARN [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 18:10:19,817 DEBUG [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 18:10:19,817 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 18:10:19,818 WARN [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 18:10:19,817 WARN [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 18:10:19,843 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 18:10:19,844 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 18:10:19,844 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:10:19,918 INFO [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40369,1689703815902 with isa=jenkins-hbase4.apache.org/172.31.14.131:40677, startcode=1689703817386 2023-07-18 18:10:19,920 INFO [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40369,1689703815902 with isa=jenkins-hbase4.apache.org/172.31.14.131:34171, startcode=1689703817322 2023-07-18 18:10:19,921 INFO [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40369,1689703815902 with isa=jenkins-hbase4.apache.org/172.31.14.131:39949, startcode=1689703817554 2023-07-18 18:10:19,927 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40369] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:19,935 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40369] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:19,936 DEBUG [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:10:19,936 DEBUG [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35301 2023-07-18 18:10:19,937 DEBUG [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 18:10:19,937 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40369] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:19,937 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:10:19,938 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35301 2023-07-18 18:10:19,938 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 18:10:19,940 DEBUG [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:10:19,940 DEBUG [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35301 2023-07-18 18:10:19,940 DEBUG [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 18:10:19,946 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:10:19,949 DEBUG [RS:1;jenkins-hbase4:40677] zookeeper.ZKUtil(162): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:19,950 WARN [RS:1;jenkins-hbase4:40677] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:10:19,950 DEBUG [RS:2;jenkins-hbase4:39949] zookeeper.ZKUtil(162): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:19,950 INFO [RS:1;jenkins-hbase4:40677] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:10:19,950 DEBUG [RS:0;jenkins-hbase4:34171] zookeeper.ZKUtil(162): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:19,950 WARN [RS:2;jenkins-hbase4:39949] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:10:19,951 DEBUG [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/WALs/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:19,951 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40677,1689703817386] 2023-07-18 18:10:19,951 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34171,1689703817322] 2023-07-18 18:10:19,951 WARN [RS:0;jenkins-hbase4:34171] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:10:19,952 INFO [RS:0;jenkins-hbase4:34171] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:10:19,951 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39949,1689703817554] 2023-07-18 18:10:19,952 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/WALs/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:19,951 INFO [RS:2;jenkins-hbase4:39949] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:10:19,952 DEBUG [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/WALs/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:19,970 DEBUG [RS:0;jenkins-hbase4:34171] zookeeper.ZKUtil(162): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:19,970 DEBUG [RS:1;jenkins-hbase4:40677] zookeeper.ZKUtil(162): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:19,971 DEBUG [RS:0;jenkins-hbase4:34171] zookeeper.ZKUtil(162): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:19,972 DEBUG [RS:1;jenkins-hbase4:40677] zookeeper.ZKUtil(162): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:19,972 DEBUG [RS:0;jenkins-hbase4:34171] zookeeper.ZKUtil(162): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:19,972 DEBUG [RS:1;jenkins-hbase4:40677] zookeeper.ZKUtil(162): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:19,974 DEBUG [RS:2;jenkins-hbase4:39949] zookeeper.ZKUtil(162): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:19,975 DEBUG [RS:2;jenkins-hbase4:39949] zookeeper.ZKUtil(162): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:19,975 DEBUG [RS:2;jenkins-hbase4:39949] zookeeper.ZKUtil(162): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:19,986 DEBUG [RS:2;jenkins-hbase4:39949] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:10:19,986 DEBUG [RS:1;jenkins-hbase4:40677] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:10:19,986 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:10:19,999 INFO [RS:2;jenkins-hbase4:39949] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:10:19,999 INFO [RS:0;jenkins-hbase4:34171] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:10:19,999 INFO [RS:1;jenkins-hbase4:40677] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:10:20,041 INFO [RS:1;jenkins-hbase4:40677] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:10:20,041 INFO [RS:2;jenkins-hbase4:39949] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:10:20,041 INFO [RS:0;jenkins-hbase4:34171] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:10:20,046 INFO [RS:1;jenkins-hbase4:40677] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:10:20,046 INFO [RS:1;jenkins-hbase4:40677] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,047 INFO [RS:2;jenkins-hbase4:39949] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:10:20,047 INFO [RS:0;jenkins-hbase4:34171] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:10:20,047 INFO [RS:2;jenkins-hbase4:39949] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,048 INFO [RS:0;jenkins-hbase4:34171] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,048 INFO [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:10:20,048 INFO [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:10:20,051 INFO [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:10:20,064 INFO [RS:0;jenkins-hbase4:34171] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,064 INFO [RS:2;jenkins-hbase4:39949] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,064 INFO [RS:1;jenkins-hbase4:40677] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,064 DEBUG [RS:0;jenkins-hbase4:34171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,064 DEBUG [RS:2;jenkins-hbase4:39949] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,065 DEBUG [RS:0;jenkins-hbase4:34171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,065 DEBUG [RS:2;jenkins-hbase4:39949] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,065 DEBUG [RS:0;jenkins-hbase4:34171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,065 DEBUG [RS:2;jenkins-hbase4:39949] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,065 DEBUG [RS:1;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,066 DEBUG [RS:2;jenkins-hbase4:39949] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,065 DEBUG [RS:0;jenkins-hbase4:34171] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,066 DEBUG [RS:2;jenkins-hbase4:39949] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,066 DEBUG [RS:0;jenkins-hbase4:34171] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,066 DEBUG [RS:1;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,066 DEBUG [RS:0;jenkins-hbase4:34171] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:10:20,066 DEBUG [RS:2;jenkins-hbase4:39949] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:10:20,066 DEBUG [RS:0;jenkins-hbase4:34171] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,066 DEBUG [RS:2;jenkins-hbase4:39949] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,066 DEBUG [RS:1;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,067 DEBUG [RS:2;jenkins-hbase4:39949] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,067 DEBUG [RS:1;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,067 DEBUG [RS:2;jenkins-hbase4:39949] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,067 DEBUG [RS:1;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,067 DEBUG [RS:2;jenkins-hbase4:39949] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,067 DEBUG [RS:1;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:10:20,067 DEBUG [RS:0;jenkins-hbase4:34171] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,067 DEBUG [RS:1;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,068 DEBUG [RS:0;jenkins-hbase4:34171] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,068 DEBUG [RS:1;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,068 DEBUG [RS:0;jenkins-hbase4:34171] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,068 DEBUG [RS:1;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,068 INFO [RS:2;jenkins-hbase4:39949] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,068 DEBUG [RS:1;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,068 INFO [RS:2;jenkins-hbase4:39949] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,069 INFO [RS:2;jenkins-hbase4:39949] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,091 INFO [RS:0;jenkins-hbase4:34171] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,092 INFO [RS:0;jenkins-hbase4:34171] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,092 INFO [RS:0;jenkins-hbase4:34171] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,101 INFO [RS:2;jenkins-hbase4:39949] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:10:20,105 INFO [RS:2;jenkins-hbase4:39949] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39949,1689703817554-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,108 INFO [RS:1;jenkins-hbase4:40677] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,108 INFO [RS:1;jenkins-hbase4:40677] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,108 INFO [RS:1;jenkins-hbase4:40677] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,125 INFO [RS:0;jenkins-hbase4:34171] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:10:20,126 INFO [RS:0;jenkins-hbase4:34171] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34171,1689703817322-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,149 INFO [RS:1;jenkins-hbase4:40677] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:10:20,149 INFO [RS:1;jenkins-hbase4:40677] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40677,1689703817386-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,158 INFO [RS:2;jenkins-hbase4:39949] regionserver.Replication(203): jenkins-hbase4.apache.org,39949,1689703817554 started 2023-07-18 18:10:20,159 INFO [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39949,1689703817554, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39949, sessionid=0x10179a09a370003 2023-07-18 18:10:20,159 DEBUG [RS:2;jenkins-hbase4:39949] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:10:20,159 DEBUG [RS:2;jenkins-hbase4:39949] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:20,160 DEBUG [RS:2;jenkins-hbase4:39949] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39949,1689703817554' 2023-07-18 18:10:20,160 DEBUG [RS:2;jenkins-hbase4:39949] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:10:20,161 DEBUG [RS:2;jenkins-hbase4:39949] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:10:20,162 DEBUG [RS:2;jenkins-hbase4:39949] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:10:20,162 DEBUG [RS:2;jenkins-hbase4:39949] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:10:20,162 DEBUG [RS:2;jenkins-hbase4:39949] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:20,162 DEBUG [RS:2;jenkins-hbase4:39949] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39949,1689703817554' 2023-07-18 18:10:20,162 DEBUG [RS:2;jenkins-hbase4:39949] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:20,163 DEBUG [RS:2;jenkins-hbase4:39949] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:20,163 DEBUG [RS:2;jenkins-hbase4:39949] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:10:20,163 INFO [RS:2;jenkins-hbase4:39949] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:10:20,164 INFO [RS:2;jenkins-hbase4:39949] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:10:20,172 INFO [RS:0;jenkins-hbase4:34171] regionserver.Replication(203): jenkins-hbase4.apache.org,34171,1689703817322 started 2023-07-18 18:10:20,174 INFO [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34171,1689703817322, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34171, sessionid=0x10179a09a370001 2023-07-18 18:10:20,174 DEBUG [RS:0;jenkins-hbase4:34171] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:10:20,174 DEBUG [RS:0;jenkins-hbase4:34171] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:20,175 DEBUG [RS:0;jenkins-hbase4:34171] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34171,1689703817322' 2023-07-18 18:10:20,179 DEBUG [RS:0;jenkins-hbase4:34171] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:10:20,180 DEBUG [RS:0;jenkins-hbase4:34171] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:10:20,182 DEBUG [RS:0;jenkins-hbase4:34171] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:10:20,182 DEBUG [RS:0;jenkins-hbase4:34171] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:10:20,182 DEBUG [RS:0;jenkins-hbase4:34171] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:20,191 DEBUG [RS:0;jenkins-hbase4:34171] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34171,1689703817322' 2023-07-18 18:10:20,191 INFO [RS:1;jenkins-hbase4:40677] regionserver.Replication(203): jenkins-hbase4.apache.org,40677,1689703817386 started 2023-07-18 18:10:20,192 DEBUG [RS:0;jenkins-hbase4:34171] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:20,192 INFO [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40677,1689703817386, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40677, sessionid=0x10179a09a370002 2023-07-18 18:10:20,192 DEBUG [RS:1;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:10:20,192 DEBUG [RS:1;jenkins-hbase4:40677] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:20,192 DEBUG [RS:1;jenkins-hbase4:40677] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40677,1689703817386' 2023-07-18 18:10:20,192 DEBUG [RS:1;jenkins-hbase4:40677] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:10:20,193 DEBUG [RS:0;jenkins-hbase4:34171] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:20,194 DEBUG [RS:1;jenkins-hbase4:40677] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:10:20,194 DEBUG [RS:0;jenkins-hbase4:34171] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:10:20,194 INFO [RS:0;jenkins-hbase4:34171] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:10:20,195 INFO [RS:0;jenkins-hbase4:34171] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:10:20,196 DEBUG [RS:1;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:10:20,196 DEBUG [RS:1;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:10:20,196 DEBUG [RS:1;jenkins-hbase4:40677] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:20,196 DEBUG [RS:1;jenkins-hbase4:40677] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40677,1689703817386' 2023-07-18 18:10:20,196 DEBUG [RS:1;jenkins-hbase4:40677] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:20,197 DEBUG [RS:1;jenkins-hbase4:40677] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:20,198 DEBUG [RS:1;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:10:20,198 INFO [RS:1;jenkins-hbase4:40677] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:10:20,198 INFO [RS:1;jenkins-hbase4:40677] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:10:20,279 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:20,284 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 18:10:20,287 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/info 2023-07-18 18:10:20,288 INFO [RS:2;jenkins-hbase4:39949] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39949%2C1689703817554, suffix=, logDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/WALs/jenkins-hbase4.apache.org,39949,1689703817554, archiveDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/oldWALs, maxLogs=32 2023-07-18 18:10:20,288 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 18:10:20,295 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:20,295 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 18:10:20,299 INFO [RS:0;jenkins-hbase4:34171] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34171%2C1689703817322, suffix=, logDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/WALs/jenkins-hbase4.apache.org,34171,1689703817322, archiveDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/oldWALs, maxLogs=32 2023-07-18 18:10:20,311 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:10:20,312 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 18:10:20,313 INFO [RS:1;jenkins-hbase4:40677] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40677%2C1689703817386, suffix=, logDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/WALs/jenkins-hbase4.apache.org,40677,1689703817386, archiveDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/oldWALs, maxLogs=32 2023-07-18 18:10:20,313 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:20,314 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 18:10:20,326 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/table 2023-07-18 18:10:20,327 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 18:10:20,328 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:20,337 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740 2023-07-18 18:10:20,341 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740 2023-07-18 18:10:20,357 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35751,DS-799da818-4ec1-4585-9e58-cbfdb52954bd,DISK] 2023-07-18 18:10:20,358 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35181,DS-c0e532a9-9d82-4054-a2fb-a97a061289fb,DISK] 2023-07-18 18:10:20,359 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 18:10:20,362 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 18:10:20,379 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42171,DS-548b8df7-568a-4bac-86d5-6c90c28d081d,DISK] 2023-07-18 18:10:20,380 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:20,381 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42171,DS-548b8df7-568a-4bac-86d5-6c90c28d081d,DISK] 2023-07-18 18:10:20,382 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72702422, jitterRate=0.08335050940513611}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 18:10:20,382 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 18:10:20,382 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 18:10:20,382 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 18:10:20,382 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 18:10:20,382 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 18:10:20,382 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 18:10:20,383 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35181,DS-c0e532a9-9d82-4054-a2fb-a97a061289fb,DISK] 2023-07-18 18:10:20,384 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35751,DS-799da818-4ec1-4585-9e58-cbfdb52954bd,DISK] 2023-07-18 18:10:20,401 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 18:10:20,401 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 18:10:20,402 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42171,DS-548b8df7-568a-4bac-86d5-6c90c28d081d,DISK] 2023-07-18 18:10:20,402 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35751,DS-799da818-4ec1-4585-9e58-cbfdb52954bd,DISK] 2023-07-18 18:10:20,404 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35181,DS-c0e532a9-9d82-4054-a2fb-a97a061289fb,DISK] 2023-07-18 18:10:20,408 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 18:10:20,408 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-18 18:10:20,414 INFO [RS:1;jenkins-hbase4:40677] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/WALs/jenkins-hbase4.apache.org,40677,1689703817386/jenkins-hbase4.apache.org%2C40677%2C1689703817386.1689703820320 2023-07-18 18:10:20,420 DEBUG [RS:1;jenkins-hbase4:40677] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35181,DS-c0e532a9-9d82-4054-a2fb-a97a061289fb,DISK], DatanodeInfoWithStorage[127.0.0.1:42171,DS-548b8df7-568a-4bac-86d5-6c90c28d081d,DISK], DatanodeInfoWithStorage[127.0.0.1:35751,DS-799da818-4ec1-4585-9e58-cbfdb52954bd,DISK]] 2023-07-18 18:10:20,421 INFO [RS:2;jenkins-hbase4:39949] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/WALs/jenkins-hbase4.apache.org,39949,1689703817554/jenkins-hbase4.apache.org%2C39949%2C1689703817554.1689703820299 2023-07-18 18:10:20,423 DEBUG [RS:2;jenkins-hbase4:39949] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35751,DS-799da818-4ec1-4585-9e58-cbfdb52954bd,DISK], DatanodeInfoWithStorage[127.0.0.1:35181,DS-c0e532a9-9d82-4054-a2fb-a97a061289fb,DISK], DatanodeInfoWithStorage[127.0.0.1:42171,DS-548b8df7-568a-4bac-86d5-6c90c28d081d,DISK]] 2023-07-18 18:10:20,425 INFO [RS:0;jenkins-hbase4:34171] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/WALs/jenkins-hbase4.apache.org,34171,1689703817322/jenkins-hbase4.apache.org%2C34171%2C1689703817322.1689703820305 2023-07-18 18:10:20,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-18 18:10:20,432 DEBUG [RS:0;jenkins-hbase4:34171] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35751,DS-799da818-4ec1-4585-9e58-cbfdb52954bd,DISK], DatanodeInfoWithStorage[127.0.0.1:42171,DS-548b8df7-568a-4bac-86d5-6c90c28d081d,DISK], DatanodeInfoWithStorage[127.0.0.1:35181,DS-c0e532a9-9d82-4054-a2fb-a97a061289fb,DISK]] 2023-07-18 18:10:20,452 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-18 18:10:20,456 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-18 18:10:20,609 DEBUG [jenkins-hbase4:40369] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-18 18:10:20,615 DEBUG [jenkins-hbase4:40369] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:10:20,623 DEBUG [jenkins-hbase4:40369] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:10:20,623 DEBUG [jenkins-hbase4:40369] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:10:20,623 DEBUG [jenkins-hbase4:40369] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:10:20,623 DEBUG [jenkins-hbase4:40369] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:10:20,626 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39949,1689703817554, state=OPENING 2023-07-18 18:10:20,635 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-18 18:10:20,637 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:20,638 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:10:20,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39949,1689703817554}] 2023-07-18 18:10:20,837 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:20,842 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:10:20,845 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:10:20,868 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-18 18:10:20,868 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:10:20,887 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39949%2C1689703817554.meta, suffix=.meta, logDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/WALs/jenkins-hbase4.apache.org,39949,1689703817554, archiveDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/oldWALs, maxLogs=32 2023-07-18 18:10:20,930 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35181,DS-c0e532a9-9d82-4054-a2fb-a97a061289fb,DISK] 2023-07-18 18:10:20,931 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35751,DS-799da818-4ec1-4585-9e58-cbfdb52954bd,DISK] 2023-07-18 18:10:20,932 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42171,DS-548b8df7-568a-4bac-86d5-6c90c28d081d,DISK] 2023-07-18 18:10:20,950 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/WALs/jenkins-hbase4.apache.org,39949,1689703817554/jenkins-hbase4.apache.org%2C39949%2C1689703817554.meta.1689703820889.meta 2023-07-18 18:10:20,957 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35751,DS-799da818-4ec1-4585-9e58-cbfdb52954bd,DISK], DatanodeInfoWithStorage[127.0.0.1:35181,DS-c0e532a9-9d82-4054-a2fb-a97a061289fb,DISK], DatanodeInfoWithStorage[127.0.0.1:42171,DS-548b8df7-568a-4bac-86d5-6c90c28d081d,DISK]] 2023-07-18 18:10:20,958 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:10:20,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-18 18:10:20,962 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:20,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 18:10:20,967 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-18 18:10:20,968 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-18 18:10:20,994 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-18 18:10:20,994 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:20,994 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-18 18:10:20,994 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-18 18:10:20,998 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 18:10:21,000 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/info 2023-07-18 18:10:21,000 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/info 2023-07-18 18:10:21,001 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 18:10:21,002 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:21,003 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 18:10:21,004 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:10:21,004 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:10:21,005 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 18:10:21,006 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:21,006 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 18:10:21,008 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/table 2023-07-18 18:10:21,008 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/table 2023-07-18 18:10:21,009 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 18:10:21,009 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:21,011 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740 2023-07-18 18:10:21,015 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740 2023-07-18 18:10:21,019 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 18:10:21,021 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 18:10:21,023 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75333523, jitterRate=0.12255696952342987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 18:10:21,027 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 18:10:21,041 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689703820827 2023-07-18 18:10:21,066 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-18 18:10:21,069 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-18 18:10:21,069 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39949,1689703817554, state=OPEN 2023-07-18 18:10:21,077 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 18:10:21,077 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:10:21,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-18 18:10:21,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39949,1689703817554 in 436 msec 2023-07-18 18:10:21,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-18 18:10:21,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 659 msec 2023-07-18 18:10:21,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5960 sec 2023-07-18 18:10:21,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689703821100, completionTime=-1 2023-07-18 18:10:21,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-18 18:10:21,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-18 18:10:21,198 DEBUG [hconnection-0x70d141d6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:21,203 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:21,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-18 18:10:21,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689703881228 2023-07-18 18:10:21,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689703941228 2023-07-18 18:10:21,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 126 msec 2023-07-18 18:10:21,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40369,1689703815902-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:21,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40369,1689703815902-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:21,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40369,1689703815902-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:21,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40369, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:21,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:21,266 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-18 18:10:21,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-18 18:10:21,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 18:10:21,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-18 18:10:21,290 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:10:21,293 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:10:21,317 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:10:21,321 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb empty. 2023-07-18 18:10:21,322 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:10:21,323 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-18 18:10:21,371 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-18 18:10:21,374 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => f913cdf0e1eeea2ab791850e8be5efcb, NAME => 'hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:10:21,395 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:21,395 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing f913cdf0e1eeea2ab791850e8be5efcb, disabling compactions & flushes 2023-07-18 18:10:21,395 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. 2023-07-18 18:10:21,395 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. 2023-07-18 18:10:21,395 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. after waiting 0 ms 2023-07-18 18:10:21,395 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. 2023-07-18 18:10:21,395 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. 2023-07-18 18:10:21,395 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for f913cdf0e1eeea2ab791850e8be5efcb: 2023-07-18 18:10:21,405 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:10:21,424 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689703821409"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703821409"}]},"ts":"1689703821409"} 2023-07-18 18:10:21,457 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:10:21,460 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:10:21,465 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703821460"}]},"ts":"1689703821460"} 2023-07-18 18:10:21,469 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-18 18:10:21,474 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:10:21,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:10:21,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:10:21,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:10:21,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:10:21,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f913cdf0e1eeea2ab791850e8be5efcb, ASSIGN}] 2023-07-18 18:10:21,481 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f913cdf0e1eeea2ab791850e8be5efcb, ASSIGN 2023-07-18 18:10:21,484 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f913cdf0e1eeea2ab791850e8be5efcb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34171,1689703817322; forceNewPlan=false, retain=false 2023-07-18 18:10:21,637 INFO [jenkins-hbase4:40369] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:10:21,638 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f913cdf0e1eeea2ab791850e8be5efcb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:21,638 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689703821638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703821638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703821638"}]},"ts":"1689703821638"} 2023-07-18 18:10:21,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f913cdf0e1eeea2ab791850e8be5efcb, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:10:21,797 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:21,798 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:10:21,807 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:10:21,822 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. 2023-07-18 18:10:21,823 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f913cdf0e1eeea2ab791850e8be5efcb, NAME => 'hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:10:21,823 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. service=AccessControlService 2023-07-18 18:10:21,824 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:21,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:10:21,826 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:21,826 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:10:21,826 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:10:21,831 INFO [StoreOpener-f913cdf0e1eeea2ab791850e8be5efcb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:10:21,848 DEBUG [StoreOpener-f913cdf0e1eeea2ab791850e8be5efcb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb/info 2023-07-18 18:10:21,848 DEBUG [StoreOpener-f913cdf0e1eeea2ab791850e8be5efcb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb/info 2023-07-18 18:10:21,849 INFO [StoreOpener-f913cdf0e1eeea2ab791850e8be5efcb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f913cdf0e1eeea2ab791850e8be5efcb columnFamilyName info 2023-07-18 18:10:21,850 INFO [StoreOpener-f913cdf0e1eeea2ab791850e8be5efcb-1] regionserver.HStore(310): Store=f913cdf0e1eeea2ab791850e8be5efcb/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:21,853 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:10:21,854 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:10:21,860 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:10:21,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:21,866 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f913cdf0e1eeea2ab791850e8be5efcb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60609103, jitterRate=-0.09685398638248444}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:21,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f913cdf0e1eeea2ab791850e8be5efcb: 2023-07-18 18:10:21,877 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb., pid=6, masterSystemTime=1689703821797 2023-07-18 18:10:21,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. 2023-07-18 18:10:21,933 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. 2023-07-18 18:10:21,934 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f913cdf0e1eeea2ab791850e8be5efcb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:21,935 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689703821934"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703821934"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703821934"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703821934"}]},"ts":"1689703821934"} 2023-07-18 18:10:21,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-18 18:10:21,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f913cdf0e1eeea2ab791850e8be5efcb, server=jenkins-hbase4.apache.org,34171,1689703817322 in 296 msec 2023-07-18 18:10:21,948 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-18 18:10:21,948 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f913cdf0e1eeea2ab791850e8be5efcb, ASSIGN in 465 msec 2023-07-18 18:10:21,949 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:10:21,950 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703821950"}]},"ts":"1689703821950"} 2023-07-18 18:10:21,953 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-18 18:10:21,958 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:10:21,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 680 msec 2023-07-18 18:10:22,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-18 18:10:22,030 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:10:22,030 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:22,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:22,060 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:22,078 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-18 18:10:22,100 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:10:22,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-07-18 18:10:22,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 18:10:22,136 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:10:22,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-18 18:10:22,151 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-18 18:10:22,153 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-18 18:10:22,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.127sec 2023-07-18 18:10:22,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-18 18:10:22,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-18 18:10:22,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-18 18:10:22,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40369,1689703815902-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-18 18:10:22,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40369,1689703815902-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-18 18:10:22,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 18:10:22,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-18 18:10:22,191 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:10:22,194 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:10:22,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-18 18:10:22,198 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6 2023-07-18 18:10:22,199 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6 empty. 2023-07-18 18:10:22,203 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6 2023-07-18 18:10:22,203 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-18 18:10:22,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 18:10:22,242 DEBUG [Listener at localhost/39415] zookeeper.ReadOnlyZKClient(139): Connect 0x722ff5ad to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:22,250 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-18 18:10:22,253 DEBUG [Listener at localhost/39415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37ed2880, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:22,255 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => b7f6db75c1d50b5b19e0581fc19406b6, NAME => 'hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:10:22,285 DEBUG [hconnection-0x8d80b2c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:22,294 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:22,294 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing b7f6db75c1d50b5b19e0581fc19406b6, disabling compactions & flushes 2023-07-18 18:10:22,294 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. 2023-07-18 18:10:22,294 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. 2023-07-18 18:10:22,294 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. after waiting 0 ms 2023-07-18 18:10:22,294 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. 2023-07-18 18:10:22,294 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. 2023-07-18 18:10:22,294 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for b7f6db75c1d50b5b19e0581fc19406b6: 2023-07-18 18:10:22,300 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:10:22,302 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689703822302"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703822302"}]},"ts":"1689703822302"} 2023-07-18 18:10:22,303 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:22,306 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40369,1689703815902 2023-07-18 18:10:22,306 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-18 18:10:22,306 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:10:22,306 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/test.cache.data in system properties and HBase conf 2023-07-18 18:10:22,306 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 18:10:22,307 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/hadoop.log.dir in system properties and HBase conf 2023-07-18 18:10:22,307 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 18:10:22,307 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 18:10:22,307 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 18:10:22,307 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:10:22,307 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:10:22,307 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 18:10:22,308 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:10:22,308 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 18:10:22,308 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 18:10:22,308 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:10:22,308 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:10:22,308 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 18:10:22,308 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/nfs.dump.dir in system properties and HBase conf 2023-07-18 18:10:22,308 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:10:22,308 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/java.io.tmpdir in system properties and HBase conf 2023-07-18 18:10:22,309 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:10:22,309 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 18:10:22,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703822309"}]},"ts":"1689703822309"} 2023-07-18 18:10:22,309 INFO [Listener at localhost/39415] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-18 18:10:22,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 18:10:22,311 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-18 18:10:22,317 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:10:22,318 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:10:22,318 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:10:22,318 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:10:22,318 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:10:22,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=b7f6db75c1d50b5b19e0581fc19406b6, ASSIGN}] 2023-07-18 18:10:22,322 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=b7f6db75c1d50b5b19e0581fc19406b6, ASSIGN 2023-07-18 18:10:22,324 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=b7f6db75c1d50b5b19e0581fc19406b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39949,1689703817554; forceNewPlan=false, retain=false 2023-07-18 18:10:22,474 INFO [jenkins-hbase4:40369] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:10:22,475 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b7f6db75c1d50b5b19e0581fc19406b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:22,476 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689703822475"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703822475"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703822475"}]},"ts":"1689703822475"} 2023-07-18 18:10:22,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure b7f6db75c1d50b5b19e0581fc19406b6, server=jenkins-hbase4.apache.org,39949,1689703817554}] 2023-07-18 18:10:22,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 18:10:22,645 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. 2023-07-18 18:10:22,645 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b7f6db75c1d50b5b19e0581fc19406b6, NAME => 'hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:10:22,646 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. service=AccessControlService 2023-07-18 18:10:22,649 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:22,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl b7f6db75c1d50b5b19e0581fc19406b6 2023-07-18 18:10:22,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:22,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b7f6db75c1d50b5b19e0581fc19406b6 2023-07-18 18:10:22,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b7f6db75c1d50b5b19e0581fc19406b6 2023-07-18 18:10:22,652 INFO [StoreOpener-b7f6db75c1d50b5b19e0581fc19406b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region b7f6db75c1d50b5b19e0581fc19406b6 2023-07-18 18:10:22,656 DEBUG [StoreOpener-b7f6db75c1d50b5b19e0581fc19406b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6/l 2023-07-18 18:10:22,656 DEBUG [StoreOpener-b7f6db75c1d50b5b19e0581fc19406b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6/l 2023-07-18 18:10:22,657 INFO [StoreOpener-b7f6db75c1d50b5b19e0581fc19406b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7f6db75c1d50b5b19e0581fc19406b6 columnFamilyName l 2023-07-18 18:10:22,658 INFO [StoreOpener-b7f6db75c1d50b5b19e0581fc19406b6-1] regionserver.HStore(310): Store=b7f6db75c1d50b5b19e0581fc19406b6/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:22,665 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6 2023-07-18 18:10:22,668 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6 2023-07-18 18:10:22,678 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b7f6db75c1d50b5b19e0581fc19406b6 2023-07-18 18:10:22,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:22,684 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b7f6db75c1d50b5b19e0581fc19406b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64095731, jitterRate=-0.04489918053150177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:22,684 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b7f6db75c1d50b5b19e0581fc19406b6: 2023-07-18 18:10:22,687 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6., pid=11, masterSystemTime=1689703822637 2023-07-18 18:10:22,690 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. 2023-07-18 18:10:22,690 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. 2023-07-18 18:10:22,691 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b7f6db75c1d50b5b19e0581fc19406b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:22,692 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689703822691"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703822691"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703822691"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703822691"}]},"ts":"1689703822691"} 2023-07-18 18:10:22,699 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-18 18:10:22,699 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure b7f6db75c1d50b5b19e0581fc19406b6, server=jenkins-hbase4.apache.org,39949,1689703817554 in 214 msec 2023-07-18 18:10:22,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-18 18:10:22,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=b7f6db75c1d50b5b19e0581fc19406b6, ASSIGN in 381 msec 2023-07-18 18:10:22,718 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:10:22,718 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703822718"}]},"ts":"1689703822718"} 2023-07-18 18:10:22,721 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-18 18:10:22,729 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:10:22,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 542 msec 2023-07-18 18:10:22,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 18:10:22,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-18 18:10:22,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-18 18:10:23,447 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:23,776 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:23,782 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33455_jobhistory____.n7t5cz/webapp 2023-07-18 18:10:23,967 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-18 18:10:23,968 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-18 18:10:23,968 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 18:10:23,972 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 18:10:24,069 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:24,414 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:24,724 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-18 18:10:24,760 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33455 2023-07-18 18:10:24,944 WARN [Listener at jenkins-hbase4.apache.org/42363] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:25,304 WARN [Listener at jenkins-hbase4.apache.org/42363] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 18:10:25,305 INFO [Listener at jenkins-hbase4.apache.org/42363] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:25,327 INFO [Listener at jenkins-hbase4.apache.org/42363] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42737_cluster____tlj3dz/webapp 2023-07-18 18:10:25,441 INFO [Listener at jenkins-hbase4.apache.org/42363] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 18:10:25,441 INFO [Listener at jenkins-hbase4.apache.org/42363] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-18 18:10:25,441 INFO [Listener at jenkins-hbase4.apache.org/42363] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 18:10:25,442 INFO [Listener at jenkins-hbase4.apache.org/42363] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 18:10:25,461 INFO [Listener at jenkins-hbase4.apache.org/42363] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:25,748 INFO [Listener at jenkins-hbase4.apache.org/42363] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:25,911 INFO [Listener at jenkins-hbase4.apache.org/42363] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:25,926 INFO [Listener at jenkins-hbase4.apache.org/42363] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42737 2023-07-18 18:10:25,994 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-18 18:10:25,996 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-18 18:10:26,007 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-18 18:10:26,660 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:10:26,865 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:10:26,866 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-18 18:10:26,866 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:10:26,867 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-18 18:10:26,867 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 18:10:26,867 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-18 18:10:26,867 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:10:26,867 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-18 18:10:26,867 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:10:26,867 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-18 18:10:26,907 WARN [Listener at jenkins-hbase4.apache.org/36843] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:26,936 WARN [Listener at jenkins-hbase4.apache.org/36843] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 18:10:26,937 INFO [Listener at jenkins-hbase4.apache.org/36843] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:26,946 INFO [Listener at jenkins-hbase4.apache.org/36843] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38053_node____xvrd6v/webapp 2023-07-18 18:10:27,012 INFO [Listener at jenkins-hbase4.apache.org/36843] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 18:10:27,012 INFO [Listener at jenkins-hbase4.apache.org/36843] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 18:10:27,012 INFO [Listener at jenkins-hbase4.apache.org/36843] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 18:10:27,012 INFO [Listener at jenkins-hbase4.apache.org/36843] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 18:10:27,020 INFO [Listener at jenkins-hbase4.apache.org/36843] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:27,044 INFO [Listener at jenkins-hbase4.apache.org/36843] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:27,133 INFO [Listener at jenkins-hbase4.apache.org/36843] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:27,145 INFO [Listener at jenkins-hbase4.apache.org/36843] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38053 2023-07-18 18:10:27,357 WARN [Listener at jenkins-hbase4.apache.org/37995] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:27,363 WARN [Listener at jenkins-hbase4.apache.org/37995] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 18:10:27,363 INFO [Listener at jenkins-hbase4.apache.org/37995] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:27,370 INFO [Listener at jenkins-hbase4.apache.org/37995] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34295_node____z6mzuz/webapp 2023-07-18 18:10:27,428 INFO [Listener at jenkins-hbase4.apache.org/37995] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 18:10:27,428 INFO [Listener at jenkins-hbase4.apache.org/37995] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 18:10:27,429 INFO [Listener at jenkins-hbase4.apache.org/37995] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 18:10:27,429 INFO [Listener at jenkins-hbase4.apache.org/37995] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 18:10:27,436 INFO [Listener at jenkins-hbase4.apache.org/37995] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:27,450 INFO [Listener at jenkins-hbase4.apache.org/37995] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:27,520 INFO [Listener at jenkins-hbase4.apache.org/37995] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:27,535 INFO [Listener at jenkins-hbase4.apache.org/37995] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34295 2023-07-18 18:10:27,560 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-18 18:10:27,562 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:10:27,628 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=324, ProcessCount=177, AvailableMemoryMB=4854 2023-07-18 18:10:27,629 WARN [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-18 18:10:27,642 DEBUG [Listener at jenkins-hbase4.apache.org/37995] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-18 18:10:27,647 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-18 18:10:27,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 18:10:27,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:27,658 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:10:27,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-18 18:10:27,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:10:27,661 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:10:27,664 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:27,665 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:27,665 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba empty. 2023-07-18 18:10:27,666 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799 empty. 2023-07-18 18:10:27,668 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:27,668 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:27,668 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 18:10:27,696 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-18 18:10:27,698 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => a9abdbdf0c3169d40cfd6df956541dba, NAME => 'testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:10:27,698 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0a584830d0629954418508ab3a9e5799, NAME => 'testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:10:27,737 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:27,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing a9abdbdf0c3169d40cfd6df956541dba, disabling compactions & flushes 2023-07-18 18:10:27,738 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:27,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:27,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. after waiting 0 ms 2023-07-18 18:10:27,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:27,738 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:27,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for a9abdbdf0c3169d40cfd6df956541dba: 2023-07-18 18:10:27,738 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:27,739 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 0a584830d0629954418508ab3a9e5799, disabling compactions & flushes 2023-07-18 18:10:27,739 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:27,739 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:27,739 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. after waiting 0 ms 2023-07-18 18:10:27,739 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:27,739 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:27,739 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 0a584830d0629954418508ab3a9e5799: 2023-07-18 18:10:27,743 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:10:27,745 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703827744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703827744"}]},"ts":"1689703827744"} 2023-07-18 18:10:27,745 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703827744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703827744"}]},"ts":"1689703827744"} 2023-07-18 18:10:27,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:10:27,796 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:10:27,797 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:10:27,798 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703827798"}]},"ts":"1689703827798"} 2023-07-18 18:10:27,800 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-18 18:10:27,806 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:10:27,808 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:10:27,808 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:10:27,808 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:10:27,808 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:10:27,808 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9abdbdf0c3169d40cfd6df956541dba, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a584830d0629954418508ab3a9e5799, ASSIGN}] 2023-07-18 18:10:27,811 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9abdbdf0c3169d40cfd6df956541dba, ASSIGN 2023-07-18 18:10:27,812 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a584830d0629954418508ab3a9e5799, ASSIGN 2023-07-18 18:10:27,813 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9abdbdf0c3169d40cfd6df956541dba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34171,1689703817322; forceNewPlan=false, retain=false 2023-07-18 18:10:27,813 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a584830d0629954418508ab3a9e5799, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39949,1689703817554; forceNewPlan=false, retain=false 2023-07-18 18:10:27,963 INFO [jenkins-hbase4:40369] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:10:27,966 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0a584830d0629954418508ab3a9e5799, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:27,967 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703827966"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703827966"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703827966"}]},"ts":"1689703827966"} 2023-07-18 18:10:27,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:10:27,967 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a9abdbdf0c3169d40cfd6df956541dba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:27,968 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703827967"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703827967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703827967"}]},"ts":"1689703827967"} 2023-07-18 18:10:27,971 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 0a584830d0629954418508ab3a9e5799, server=jenkins-hbase4.apache.org,39949,1689703817554}] 2023-07-18 18:10:27,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure a9abdbdf0c3169d40cfd6df956541dba, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:10:28,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:28,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a584830d0629954418508ab3a9e5799, NAME => 'testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 18:10:28,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. service=AccessControlService 2023-07-18 18:10:28,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:28,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:28,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:28,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:28,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:28,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:28,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a9abdbdf0c3169d40cfd6df956541dba, NAME => 'testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 18:10:28,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. service=AccessControlService 2023-07-18 18:10:28,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:28,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:28,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:28,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:28,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:28,137 INFO [StoreOpener-0a584830d0629954418508ab3a9e5799-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:28,139 INFO [StoreOpener-a9abdbdf0c3169d40cfd6df956541dba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:28,140 DEBUG [StoreOpener-0a584830d0629954418508ab3a9e5799-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/cf 2023-07-18 18:10:28,140 DEBUG [StoreOpener-0a584830d0629954418508ab3a9e5799-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/cf 2023-07-18 18:10:28,141 DEBUG [StoreOpener-a9abdbdf0c3169d40cfd6df956541dba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/cf 2023-07-18 18:10:28,141 DEBUG [StoreOpener-a9abdbdf0c3169d40cfd6df956541dba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/cf 2023-07-18 18:10:28,144 INFO [StoreOpener-0a584830d0629954418508ab3a9e5799-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a584830d0629954418508ab3a9e5799 columnFamilyName cf 2023-07-18 18:10:28,144 INFO [StoreOpener-a9abdbdf0c3169d40cfd6df956541dba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9abdbdf0c3169d40cfd6df956541dba columnFamilyName cf 2023-07-18 18:10:28,147 INFO [StoreOpener-a9abdbdf0c3169d40cfd6df956541dba-1] regionserver.HStore(310): Store=a9abdbdf0c3169d40cfd6df956541dba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:28,147 INFO [StoreOpener-0a584830d0629954418508ab3a9e5799-1] regionserver.HStore(310): Store=0a584830d0629954418508ab3a9e5799/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:28,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:28,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:28,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:28,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:28,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:28,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:28,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:28,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:28,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a584830d0629954418508ab3a9e5799; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65267907, jitterRate=-0.0274323970079422}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:28,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a584830d0629954418508ab3a9e5799: 2023-07-18 18:10:28,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a9abdbdf0c3169d40cfd6df956541dba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64048644, jitterRate=-0.045600831508636475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:28,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a9abdbdf0c3169d40cfd6df956541dba: 2023-07-18 18:10:28,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799., pid=15, masterSystemTime=1689703828125 2023-07-18 18:10:28,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba., pid=16, masterSystemTime=1689703828128 2023-07-18 18:10:28,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:28,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:28,167 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0a584830d0629954418508ab3a9e5799, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,168 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703828167"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703828167"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703828167"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703828167"}]},"ts":"1689703828167"} 2023-07-18 18:10:28,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:28,169 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a9abdbdf0c3169d40cfd6df956541dba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:28,174 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703828168"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703828168"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703828168"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703828168"}]},"ts":"1689703828168"} 2023-07-18 18:10:28,180 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-18 18:10:28,180 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 0a584830d0629954418508ab3a9e5799, server=jenkins-hbase4.apache.org,39949,1689703817554 in 205 msec 2023-07-18 18:10:28,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-18 18:10:28,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure a9abdbdf0c3169d40cfd6df956541dba, server=jenkins-hbase4.apache.org,34171,1689703817322 in 203 msec 2023-07-18 18:10:28,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a584830d0629954418508ab3a9e5799, ASSIGN in 372 msec 2023-07-18 18:10:28,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-18 18:10:28,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9abdbdf0c3169d40cfd6df956541dba, ASSIGN in 374 msec 2023-07-18 18:10:28,186 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:10:28,186 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703828186"}]},"ts":"1689703828186"} 2023-07-18 18:10:28,188 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-18 18:10:28,191 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:10:28,196 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-18 18:10:28,212 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 18:10:28,243 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:28,243 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:28,243 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:28,243 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:28,243 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:28,247 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:28,247 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:28,253 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:28,253 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:28,253 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:28,255 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:28,255 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:28,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 601 msec 2023-07-18 18:10:28,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:10:28,269 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-18 18:10:28,274 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-18 18:10:28,275 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:28,278 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:10:28,301 DEBUG [hconnection-0x8d80b2c-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:28,304 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:28,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 18:10:28,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703828331 (current time:1689703828331). 2023-07-18 18:10:28,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:10:28,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x0d122c7a to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:28,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f648d2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:28,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:28,342 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:28,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d122c7a to 127.0.0.1:57608 2023-07-18 18:10:28,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:28,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x7350377c to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:28,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78cc6d42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:28,354 DEBUG [hconnection-0x5e7c5d92-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:28,356 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:28,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7350377c to 127.0.0.1:57608 2023-07-18 18:10:28,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:28,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 18:10:28,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:10:28,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 18:10:28,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 18:10:28,406 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 18:10:28,407 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689704428407 2023-07-18 18:10:28,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 18:10:28,407 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 18:10:28,410 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 18:10:28,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 18:10:28,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-07-18 18:10:28,413 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 18:10:28,414 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689704428414 2023-07-18 18:10:28,415 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:10:28,415 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:10:28,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,442 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-18 18:10:28,442 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:28,443 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 18:10:28,443 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 18:10:28,443 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,443 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,448 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:28,448 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,448 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:28,448 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:28,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:28,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:28,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:28,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:28,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:28,449 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:28,449 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,449 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,449 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:10:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 18:10:28,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 18:10:28,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 18:10:28,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 18:10:28,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 18:10:28,452 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 18:10:28,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,455 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 18:10:28,455 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:28,455 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 18:10:28,456 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 18:10:28,456 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:28,456 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 18:10:28,457 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 18:10:28,457 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 18:10:28,456 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 18:10:28,457 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 18:10:28,457 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:28,457 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 18:10:28,457 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 18:10:28,458 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 18:10:28,458 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 18:10:28,460 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,460 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:28,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:28,461 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:28,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:28,461 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,462 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:28,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:28,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,464 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,464 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:28,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:28,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:28,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 18:10:28,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6572b47e[Count = 1] remaining members to acquire global barrier 2023-07-18 18:10:28,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:28,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:28,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:28,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:28,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:28,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:28,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 18:10:28,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6572b47e[Count = 0] remaining members to acquire global barrier 2023-07-18 18:10:28,468 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 18:10:28,469 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,471 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,471 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,471 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,471 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 18:10:28,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,472 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 18:10:28,472 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 18:10:28,472 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 18:10:28,472 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:10:28,472 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,473 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:28,473 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:28,473 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:28,473 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:28,473 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. started... 2023-07-18 18:10:28,475 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a9abdbdf0c3169d40cfd6df956541dba: 2023-07-18 18:10:28,477 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,473 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:28,477 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,477 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 18:10:28,477 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:10:28,473 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. started... 2023-07-18 18:10:28,477 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:28,477 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:28,477 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 18:10:28,479 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a584830d0629954418508ab3a9e5799: 2023-07-18 18:10:28,479 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,483 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:28,483 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:28,487 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:10:28,487 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:10:28,511 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. completed. 2023-07-18 18:10:28,511 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. completed. 2023-07-18 18:10:28,511 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:28,512 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:28,512 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:28,512 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:28,512 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,512 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 18:10:28,512 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:10:28,512 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:28,513 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:28,513 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,513 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 18:10:28,513 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:10:28,515 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,515 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 18:10:28,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:28,515 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:28,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:28,515 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 18:10:28,516 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:28,516 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 18:10:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:28,516 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 18:10:28,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:28,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:28,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:28,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:28,524 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:10:28,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:28,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39949,1689703817554': 2023-07-18 18:10:28,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 18:10:28,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:28,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:28,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:28,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:28,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:28,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34171,1689703817322': 2023-07-18 18:10:28,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 18:10:28,530 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-18 18:10:28,530 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:10:28,530 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:10:28,530 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,530 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:10:28,534 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,534 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:28,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:28,534 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:28,534 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,534 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,535 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:28,535 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:28,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:28,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:28,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:28,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:28,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:28,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:28,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:28,536 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:28,537 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,538 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:28,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:28,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:28,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,541 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,541 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:28,542 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:28,559 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:28,559 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:28,559 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,559 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,559 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:28,559 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,559 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:28,559 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:28,559 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:28,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:28,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,559 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:28,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:28,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:28,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-18 18:10:28,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:28,559 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:28,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:28,559 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:28,559 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:28,560 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:28,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 18:10:28,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:28,560 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:28,561 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:28,561 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,561 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:28,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:28,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:28,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:28,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 18:10:28,724 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:28,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:28,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:28,727 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:10:28,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:29,034 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:29,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:29,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:29,036 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 18:10:29,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:29,152 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 18:10:29,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:29,153 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:29,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689703828408Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689703828984 (+576 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689703828984Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689703828985 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689703829011 (+26 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689703829061 (+50 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689703829152 (+91 ms) 2023-07-18 18:10:29,156 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 18:10:29,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 747 msec 2023-07-18 18:10:29,536 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:29,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:29,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:10:29,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34171] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:10:29,557 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39949] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:10:29,562 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-18 18:10:29,562 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:29,563 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:10:29,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 18:10:29,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703829578 (current time:1689703829578). 2023-07-18 18:10:29,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:10:29,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x4452142a to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:29,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ab09345, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:29,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:29,590 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:29,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4452142a to 127.0.0.1:57608 2023-07-18 18:10:29,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:29,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x74f4ded9 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:29,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20d37729, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:29,598 DEBUG [hconnection-0x6eb7e2cd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:29,599 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:29,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74f4ded9 to 127.0.0.1:57608 2023-07-18 18:10:29,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:29,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 18:10:29,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:10:29,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 18:10:29,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 18:10:29,609 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 18:10:29,610 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689704429610 2023-07-18 18:10:29,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 18:10:29,610 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 18:10:29,611 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:10:29,611 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:10:29,612 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 18:10:29,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 18:10:29,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 5 msec 2023-07-18 18:10:29,615 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 18:10:29,616 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689704429616 2023-07-18 18:10:29,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-18 18:10:29,630 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-18 18:10:29,630 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:29,631 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 18:10:29,631 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 18:10:29,632 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,632 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,633 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:29,633 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:29,633 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:29,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:29,633 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:29,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:29,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:29,634 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:29,634 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:29,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,634 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:29,634 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:10:29,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 18:10:29,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 18:10:29,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 18:10:29,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 18:10:29,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 18:10:29,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 18:10:29,635 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 18:10:29,635 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 18:10:29,636 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 18:10:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 18:10:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 18:10:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 18:10:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:29,636 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 18:10:29,637 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 18:10:29,637 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 18:10:29,637 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 18:10:29,638 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 18:10:29,638 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 18:10:29,637 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 18:10:29,638 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 18:10:29,638 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 18:10:29,640 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:29,640 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:29,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:29,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:29,641 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:29,641 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,641 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,641 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:29,641 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:29,642 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,642 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:29,642 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,642 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:29,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:29,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:29,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:29,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:29,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:29,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 18:10:29,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d67f5af[Count = 1] remaining members to acquire global barrier 2023-07-18 18:10:29,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:29,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:29,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:29,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:29,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:29,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:29,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:29,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:29,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:29,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 18:10:29,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d67f5af[Count = 0] remaining members to acquire global barrier 2023-07-18 18:10:29,646 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 18:10:29,646 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,652 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,652 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,652 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:29,652 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,652 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 18:10:29,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,652 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 18:10:29,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,653 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:29,653 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:29,653 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:29,653 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 18:10:29,653 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:29,653 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:10:29,653 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 18:10:29,653 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. started... 2023-07-18 18:10:29,653 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:10:29,653 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:29,653 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:29,653 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:29,653 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a9abdbdf0c3169d40cfd6df956541dba 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-18 18:10:29,654 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. started... 2023-07-18 18:10:29,654 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0a584830d0629954418508ab3a9e5799 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-18 18:10:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 18:10:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 18:10:29,711 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:29,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:29,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:29,714 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:10:29,805 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307184a4df15d92e14291a32db8adcf2ce00e to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307184a4df15d92e14291a32db8adcf2ce00e 2023-07-18 18:10:29,805 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307186cadbe6a7a4142a89c023c9b6a8827b8 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307186cadbe6a7a4142a89c023c9b6a8827b8 2023-07-18 18:10:29,854 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/.tmp/cf/31214944a88849a8bb141c038213fb91 2023-07-18 18:10:29,864 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/.tmp/cf/31214944a88849a8bb141c038213fb91 as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/cf/31214944a88849a8bb141c038213fb91 2023-07-18 18:10:29,873 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/cf/31214944a88849a8bb141c038213fb91, entries=48, sequenceid=6, filesize=13.0 K 2023-07-18 18:10:29,875 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 0a584830d0629954418508ab3a9e5799 in 221ms, sequenceid=6, compaction requested=false 2023-07-18 18:10:29,875 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-18 18:10:29,876 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a584830d0629954418508ab3a9e5799: 2023-07-18 18:10:29,876 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 18:10:29,876 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:29,877 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/cf/31214944a88849a8bb141c038213fb91] hfiles 2023-07-18 18:10:29,877 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/cf/31214944a88849a8bb141c038213fb91 for snapshot=snaptb0-testExportWithTargetName 2023-07-18 18:10:29,900 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. completed. 2023-07-18 18:10:29,900 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:29,900 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:29,901 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:29,902 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:29,902 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 18:10:29,902 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:10:29,903 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 18:10:29,903 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:29,903 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:29,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:29,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:29,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:29,904 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 18:10:29,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:29,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:29,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:29,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:29,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:29,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:29,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:29,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:29,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39949,1689703817554': 2023-07-18 18:10:29,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 18:10:29,914 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:29,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:29,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:29,915 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:10:30,216 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:30,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:30,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:30,217 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 18:10:30,254 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/.tmp/cf/98a11776c8254f8d8597ba791ecff83e 2023-07-18 18:10:30,268 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/.tmp/cf/98a11776c8254f8d8597ba791ecff83e as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/cf/98a11776c8254f8d8597ba791ecff83e 2023-07-18 18:10:30,276 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/cf/98a11776c8254f8d8597ba791ecff83e, entries=2, sequenceid=6, filesize=5.2 K 2023-07-18 18:10:30,279 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for a9abdbdf0c3169d40cfd6df956541dba in 626ms, sequenceid=6, compaction requested=false 2023-07-18 18:10:30,281 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a9abdbdf0c3169d40cfd6df956541dba: 2023-07-18 18:10:30,282 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 18:10:30,282 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:30,282 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/cf/98a11776c8254f8d8597ba791ecff83e] hfiles 2023-07-18 18:10:30,282 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/cf/98a11776c8254f8d8597ba791ecff83e for snapshot=snaptb0-testExportWithTargetName 2023-07-18 18:10:30,304 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. completed. 2023-07-18 18:10:30,304 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:30,304 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:30,305 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:30,305 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:30,305 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 18:10:30,305 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:10:30,307 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:30,307 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 18:10:30,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:30,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:30,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:30,307 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:30,307 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 18:10:30,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:30,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:30,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:30,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:30,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:30,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:30,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:30,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34171,1689703817322': 2023-07-18 18:10:30,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 18:10:30,312 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-18 18:10:30,312 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:10:30,312 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:10:30,313 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-18 18:10:30,313 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:10:30,316 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,316 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:30,316 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:30,316 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,316 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,316 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:30,316 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:30,317 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:30,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:30,319 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:30,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:30,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:30,321 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:30,323 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:30,324 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:30,324 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:30,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:30,334 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:30,334 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:30,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:30,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:30,334 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:30,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-18 18:10:30,334 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:30,334 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:30,335 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:30,335 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:30,335 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:30,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-18 18:10:30,335 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:30,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 18:10:30,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:30,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:30,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 18:10:30,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:30,335 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:30,336 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:30,337 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,337 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:30,337 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,337 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:30,337 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:30,337 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,337 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:30,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:30,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:30,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:30,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:30,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:30,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307186cadbe6a7a4142a89c023c9b6a8827b8, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307184a4df15d92e14291a32db8adcf2ce00e] mob files 2023-07-18 18:10:30,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307186cadbe6a7a4142a89c023c9b6a8827b8 2023-07-18 18:10:30,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307184a4df15d92e14291a32db8adcf2ce00e 2023-07-18 18:10:30,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-18 18:10:30,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,446 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 18:10:30,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,446 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 18:10:30,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689703829610Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689703830363 (+753 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689703830363Loading Region manifests for snaptb0-testExportWithTargetName at 1689703830363Writing data manifest for snaptb0-testExportWithTargetName at 1689703830369 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689703830390 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689703830446 (+56 ms) 2023-07-18 18:10:30,448 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 18:10:30,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 838 msec 2023-07-18 18:10:30,718 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:30,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:30,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:10:30,722 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703830722 2023-07-18 18:10:30,723 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35301, tgtDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703830722, rawTgtDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703830722, srcFsUri=hdfs://localhost:35301, srcDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:10:30,789 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:10:30,789 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_760323764_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703830722, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703830722/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 18:10:30,790 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9, snapshotDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-18 18:10:30,840 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703830722/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 18:10:31,032 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,033 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,034 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,034 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,035 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,035 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,036 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,130 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/hadoop-1171818717817793758.jar 2023-07-18 18:10:31,131 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,131 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,132 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,133 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,133 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,134 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:31,134 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:10:31,135 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:10:31,136 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:10:31,136 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:10:31,137 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:10:31,138 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:10:31,138 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:10:31,139 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:10:31,139 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:10:31,140 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:10:31,144 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:31,145 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:31,145 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:10:31,146 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:31,146 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:31,146 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:10:31,147 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:10:32,154 WARN [Listener at jenkins-hbase4.apache.org/37995] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:10:32,163 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-18 18:10:32,177 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-18 18:10:32,735 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:10:32,738 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:10:33,435 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0001_000001 (auth:SIMPLE) 2023-07-18 18:10:33,644 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:10:38,539 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0001_000001 (auth:SIMPLE) 2023-07-18 18:10:40,841 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0001_000001 (auth:SIMPLE) 2023-07-18 18:10:43,855 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0001_000001 (auth:SIMPLE) 2023-07-18 18:10:45,000 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:10:45,004 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:10:45,017 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-18 18:10:45,017 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:10:45,018 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:10:45,018 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-859359611_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 18:10:45,018 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-18 18:10:45,019 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-18 18:10:45,019 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-859359611_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703830722/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703830722/.hbase-snapshot/testExportWithTargetName 2023-07-18 18:10:45,019 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703830722/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-18 18:10:45,019 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703830722/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-18 18:10:45,031 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-18 18:10:45,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-18 18:10:45,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:45,051 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703845050"}]},"ts":"1689703845050"} 2023-07-18 18:10:45,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:10:45,052 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-18 18:10:45,103 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-18 18:10:45,106 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9abdbdf0c3169d40cfd6df956541dba, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a584830d0629954418508ab3a9e5799, UNASSIGN}] 2023-07-18 18:10:45,109 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a584830d0629954418508ab3a9e5799, UNASSIGN 2023-07-18 18:10:45,109 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9abdbdf0c3169d40cfd6df956541dba, UNASSIGN 2023-07-18 18:10:45,110 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0a584830d0629954418508ab3a9e5799, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:45,110 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=a9abdbdf0c3169d40cfd6df956541dba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:45,110 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703845110"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703845110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703845110"}]},"ts":"1689703845110"} 2023-07-18 18:10:45,110 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703845110"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703845110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703845110"}]},"ts":"1689703845110"} 2023-07-18 18:10:45,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 0a584830d0629954418508ab3a9e5799, server=jenkins-hbase4.apache.org,39949,1689703817554}] 2023-07-18 18:10:45,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure a9abdbdf0c3169d40cfd6df956541dba, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:10:45,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:10:45,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:45,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:45,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a584830d0629954418508ab3a9e5799, disabling compactions & flushes 2023-07-18 18:10:45,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a9abdbdf0c3169d40cfd6df956541dba, disabling compactions & flushes 2023-07-18 18:10:45,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:45,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:45,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:45,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:45,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. after waiting 0 ms 2023-07-18 18:10:45,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:45,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. after waiting 0 ms 2023-07-18 18:10:45,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:45,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:10:45,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:10:45,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:10:45,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:10:45,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799. 2023-07-18 18:10:45,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba. 2023-07-18 18:10:45,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a584830d0629954418508ab3a9e5799: 2023-07-18 18:10:45,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a9abdbdf0c3169d40cfd6df956541dba: 2023-07-18 18:10:45,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:45,296 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0a584830d0629954418508ab3a9e5799, regionState=CLOSED 2023-07-18 18:10:45,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:45,296 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703845296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703845296"}]},"ts":"1689703845296"} 2023-07-18 18:10:45,297 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=a9abdbdf0c3169d40cfd6df956541dba, regionState=CLOSED 2023-07-18 18:10:45,297 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703845297"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703845297"}]},"ts":"1689703845297"} 2023-07-18 18:10:45,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-18 18:10:45,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-18 18:10:45,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 0a584830d0629954418508ab3a9e5799, server=jenkins-hbase4.apache.org,39949,1689703817554 in 187 msec 2023-07-18 18:10:45,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure a9abdbdf0c3169d40cfd6df956541dba, server=jenkins-hbase4.apache.org,34171,1689703817322 in 187 msec 2023-07-18 18:10:45,306 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0a584830d0629954418508ab3a9e5799, UNASSIGN in 198 msec 2023-07-18 18:10:45,307 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-18 18:10:45,307 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a9abdbdf0c3169d40cfd6df956541dba, UNASSIGN in 198 msec 2023-07-18 18:10:45,308 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703845307"}]},"ts":"1689703845307"} 2023-07-18 18:10:45,309 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-18 18:10:45,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:10:45,356 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-18 18:10:45,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 318 msec 2023-07-18 18:10:45,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:10:45,656 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-18 18:10:45,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-18 18:10:45,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:45,677 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:45,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-18 18:10:45,680 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:45,684 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-18 18:10:45,687 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:45,687 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:45,691 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/recovered.edits] 2023-07-18 18:10:45,691 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/recovered.edits] 2023-07-18 18:10:45,699 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/cf/31214944a88849a8bb141c038213fb91 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/cf/31214944a88849a8bb141c038213fb91 2023-07-18 18:10:45,700 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/cf/98a11776c8254f8d8597ba791ecff83e to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/cf/98a11776c8254f8d8597ba791ecff83e 2023-07-18 18:10:45,709 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/recovered.edits/9.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba/recovered.edits/9.seqid 2023-07-18 18:10:45,709 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/recovered.edits/9.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799/recovered.edits/9.seqid 2023-07-18 18:10:45,710 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/a9abdbdf0c3169d40cfd6df956541dba 2023-07-18 18:10:45,710 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportWithTargetName/0a584830d0629954418508ab3a9e5799 2023-07-18 18:10:45,710 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 18:10:45,711 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-18 18:10:45,711 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-18 18:10:45,716 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307186cadbe6a7a4142a89c023c9b6a8827b8 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307186cadbe6a7a4142a89c023c9b6a8827b8 2023-07-18 18:10:45,717 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307184a4df15d92e14291a32db8adcf2ce00e to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307184a4df15d92e14291a32db8adcf2ce00e 2023-07-18 18:10:45,718 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-18 18:10:45,721 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:45,746 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-18 18:10:45,756 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:45,758 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:45,756 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:45,756 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:45,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 18:10:45,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 18:10:45,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 18:10:45,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 18:10:45,761 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-18 18:10:45,762 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:45,762 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-18 18:10:45,763 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703845762"}]},"ts":"9223372036854775807"} 2023-07-18 18:10:45,763 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703845762"}]},"ts":"9223372036854775807"} 2023-07-18 18:10:45,765 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 18:10:45,765 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a9abdbdf0c3169d40cfd6df956541dba, NAME => 'testtb-testExportWithTargetName,,1689703827653.a9abdbdf0c3169d40cfd6df956541dba.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0a584830d0629954418508ab3a9e5799, NAME => 'testtb-testExportWithTargetName,1,1689703827653.0a584830d0629954418508ab3a9e5799.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 18:10:45,765 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-18 18:10:45,765 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703845765"}]},"ts":"9223372036854775807"} 2023-07-18 18:10:45,767 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-18 18:10:45,787 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:45,787 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:45,787 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:45,787 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:45,787 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:45,787 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:45,787 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:45,787 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:45,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 18:10:45,804 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:45,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 139 msec 2023-07-18 18:10:45,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 18:10:45,892 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-18 18:10:45,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-18 18:10:45,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:45,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-18 18:10:45,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-18 18:10:45,947 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=748 (was 704) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:41641 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:58512 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:42112 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:35250 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:45227 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2087618327_1 at /127.0.0.1:35208 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) - Thread LEAK? -, OpenFileDescriptor=920 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=329 (was 324) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=3090 (was 4854) 2023-07-18 18:10:45,948 WARN [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-18 18:10:45,972 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=748, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=329, ProcessCount=183, AvailableMemoryMB=3089 2023-07-18 18:10:45,973 WARN [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-18 18:10:45,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 18:10:45,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:10:45,981 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:10:45,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-18 18:10:45,983 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:10:45,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 18:10:45,987 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f 2023-07-18 18:10:45,987 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:10:45,988 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f empty. 2023-07-18 18:10:45,988 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 empty. 2023-07-18 18:10:45,988 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f 2023-07-18 18:10:45,989 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:10:45,989 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 18:10:46,002 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 18:10:46,003 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 626973f1991d6de447a3639fa66ba64f, NAME => 'testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:10:46,003 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, NAME => 'testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:10:46,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:46,029 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:46,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, disabling compactions & flushes 2023-07-18 18:10:46,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 626973f1991d6de447a3639fa66ba64f, disabling compactions & flushes 2023-07-18 18:10:46,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:10:46,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:46,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:10:46,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:46,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. after waiting 0 ms 2023-07-18 18:10:46,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. after waiting 0 ms 2023-07-18 18:10:46,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:46,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:10:46,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:46,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:10:46,031 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69: 2023-07-18 18:10:46,030 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 626973f1991d6de447a3639fa66ba64f: 2023-07-18 18:10:46,033 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:10:46,035 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703846034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703846034"}]},"ts":"1689703846034"} 2023-07-18 18:10:46,035 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703846034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703846034"}]},"ts":"1689703846034"} 2023-07-18 18:10:46,037 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:10:46,038 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:10:46,038 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703846038"}]},"ts":"1689703846038"} 2023-07-18 18:10:46,040 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 18:10:46,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 18:10:46,095 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:10:46,097 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:10:46,097 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:10:46,097 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:10:46,097 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:10:46,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=626973f1991d6de447a3639fa66ba64f, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, ASSIGN}] 2023-07-18 18:10:46,100 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, ASSIGN 2023-07-18 18:10:46,100 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=626973f1991d6de447a3639fa66ba64f, ASSIGN 2023-07-18 18:10:46,101 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34171,1689703817322; forceNewPlan=false, retain=false 2023-07-18 18:10:46,101 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=626973f1991d6de447a3639fa66ba64f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39949,1689703817554; forceNewPlan=false, retain=false 2023-07-18 18:10:46,251 INFO [jenkins-hbase4:40369] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:10:46,254 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=626973f1991d6de447a3639fa66ba64f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:46,254 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:46,254 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703846254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703846254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703846254"}]},"ts":"1689703846254"} 2023-07-18 18:10:46,254 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703846254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703846254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703846254"}]},"ts":"1689703846254"} 2023-07-18 18:10:46,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 626973f1991d6de447a3639fa66ba64f, server=jenkins-hbase4.apache.org,39949,1689703817554}] 2023-07-18 18:10:46,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:10:46,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 18:10:46,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:10:46,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:46,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, NAME => 'testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 18:10:46,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 626973f1991d6de447a3639fa66ba64f, NAME => 'testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 18:10:46,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. service=AccessControlService 2023-07-18 18:10:46,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:46,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:10:46,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. service=AccessControlService 2023-07-18 18:10:46,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:46,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:10:46,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:46,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:10:46,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 626973f1991d6de447a3639fa66ba64f 2023-07-18 18:10:46,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:46,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 626973f1991d6de447a3639fa66ba64f 2023-07-18 18:10:46,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 626973f1991d6de447a3639fa66ba64f 2023-07-18 18:10:46,415 INFO [StoreOpener-5a9a6d7b6ad53dd5b0f3a2f2be8c7a69-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:10:46,415 INFO [StoreOpener-626973f1991d6de447a3639fa66ba64f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 626973f1991d6de447a3639fa66ba64f 2023-07-18 18:10:46,417 DEBUG [StoreOpener-5a9a6d7b6ad53dd5b0f3a2f2be8c7a69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/cf 2023-07-18 18:10:46,417 DEBUG [StoreOpener-5a9a6d7b6ad53dd5b0f3a2f2be8c7a69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/cf 2023-07-18 18:10:46,417 DEBUG [StoreOpener-626973f1991d6de447a3639fa66ba64f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/cf 2023-07-18 18:10:46,417 DEBUG [StoreOpener-626973f1991d6de447a3639fa66ba64f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/cf 2023-07-18 18:10:46,417 INFO [StoreOpener-5a9a6d7b6ad53dd5b0f3a2f2be8c7a69-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 columnFamilyName cf 2023-07-18 18:10:46,417 INFO [StoreOpener-626973f1991d6de447a3639fa66ba64f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 626973f1991d6de447a3639fa66ba64f columnFamilyName cf 2023-07-18 18:10:46,419 INFO [StoreOpener-626973f1991d6de447a3639fa66ba64f-1] regionserver.HStore(310): Store=626973f1991d6de447a3639fa66ba64f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:46,419 INFO [StoreOpener-5a9a6d7b6ad53dd5b0f3a2f2be8c7a69-1] regionserver.HStore(310): Store=5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:46,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f 2023-07-18 18:10:46,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:10:46,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f 2023-07-18 18:10:46,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:10:46,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 626973f1991d6de447a3639fa66ba64f 2023-07-18 18:10:46,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:10:46,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:46,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:46,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 626973f1991d6de447a3639fa66ba64f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75382898, jitterRate=0.1232927143573761}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:46,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 626973f1991d6de447a3639fa66ba64f: 2023-07-18 18:10:46,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64093706, jitterRate=-0.04492935538291931}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:46,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69: 2023-07-18 18:10:46,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f., pid=30, masterSystemTime=1689703846409 2023-07-18 18:10:46,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:46,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:46,433 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=626973f1991d6de447a3639fa66ba64f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:46,433 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703846433"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703846433"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703846433"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703846433"}]},"ts":"1689703846433"} 2023-07-18 18:10:46,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69., pid=31, masterSystemTime=1689703846409 2023-07-18 18:10:46,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:10:46,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:10:46,436 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:46,438 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703846436"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703846436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703846436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703846436"}]},"ts":"1689703846436"} 2023-07-18 18:10:46,440 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-18 18:10:46,440 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 626973f1991d6de447a3639fa66ba64f, server=jenkins-hbase4.apache.org,39949,1689703817554 in 180 msec 2023-07-18 18:10:46,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=626973f1991d6de447a3639fa66ba64f, ASSIGN in 343 msec 2023-07-18 18:10:46,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-18 18:10:46,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, server=jenkins-hbase4.apache.org,34171,1689703817322 in 182 msec 2023-07-18 18:10:46,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-18 18:10:46,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, ASSIGN in 351 msec 2023-07-18 18:10:46,452 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:10:46,452 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703846452"}]},"ts":"1689703846452"} 2023-07-18 18:10:46,454 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 18:10:46,513 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:10:46,514 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-18 18:10:46,516 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 18:10:46,557 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:46,557 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:46,557 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:46,557 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:46,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 18:10:46,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:46,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:46,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:46,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:46,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 619 msec 2023-07-18 18:10:47,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 18:10:47,089 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-18 18:10:47,095 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-18 18:10:47,095 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:47,097 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:10:47,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:10:47,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703847115 (current time:1689703847115). 2023-07-18 18:10:47,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:10:47,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x3e9f5894 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:47,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e545932, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:47,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:47,163 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:47,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e9f5894 to 127.0.0.1:57608 2023-07-18 18:10:47,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:47,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x53881503 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:47,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1717ac1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:47,267 DEBUG [hconnection-0x3ba6fa07-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:47,271 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:47,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53881503 to 127.0.0.1:57608 2023-07-18 18:10:47,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:47,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 18:10:47,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:10:47,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:10:47,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:10:47,285 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:10:47,286 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689704447286 2023-07-18 18:10:47,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 18:10:47,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:10:47,288 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:10:47,288 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:10:47,289 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:10:47,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 18:10:47,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-18 18:10:47,292 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 18:10:47,293 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689704447293 2023-07-18 18:10:47,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,309 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-18 18:10:47,309 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:47,311 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 18:10:47,311 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 18:10:47,326 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,326 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,380 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,380 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:47,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:47,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:47,382 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:47,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:47,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:47,382 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:47,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:47,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:47,383 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,383 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,383 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,383 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:10:47,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 18:10:47,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 18:10:47,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 18:10:47,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,385 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 18:10:47,384 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 18:10:47,384 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 18:10:47,386 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 18:10:47,386 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,386 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 18:10:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:47,388 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 18:10:47,388 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 18:10:47,388 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 18:10:47,388 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:47,388 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 18:10:47,390 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 18:10:47,391 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 18:10:47,391 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 18:10:47,391 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 18:10:47,392 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 18:10:47,392 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 18:10:47,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:47,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:47,393 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:10:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,498 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,498 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:47,533 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,533 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:47,534 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:47,533 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,533 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,534 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:47,534 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,534 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:47,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:47,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:47,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:47,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 18:10:47,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46fba5fd[Count = 1] remaining members to acquire global barrier 2023-07-18 18:10:47,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:47,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:47,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:47,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:47,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 18:10:47,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46fba5fd[Count = 0] remaining members to acquire global barrier 2023-07-18 18:10:47,538 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 18:10:47,539 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,572 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,572 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,572 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,572 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:10:47,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,573 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:10:47,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,573 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:47,573 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:47,573 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,573 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:10:47,573 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. started... 2023-07-18 18:10:47,573 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. started... 2023-07-18 18:10:47,573 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:47,573 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:47,573 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 626973f1991d6de447a3639fa66ba64f: 2023-07-18 18:10:47,575 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69: 2023-07-18 18:10:47,573 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:10:47,575 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,573 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:47,575 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,575 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,575 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:47,575 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:10:47,575 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:10:47,575 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 18:10:47,575 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:47,575 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:10:47,576 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:10:47,590 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. completed. 2023-07-18 18:10:47,590 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. completed. 2023-07-18 18:10:47,590 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:10:47,590 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:47,591 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:47,591 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:47,591 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:47,591 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,591 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:47,591 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 18:10:47,591 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,591 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:10:47,591 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 18:10:47,591 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:10:47,593 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:47,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:47,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:47,594 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:10:47,603 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 18:10:47,603 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:47,603 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 18:10:47,634 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,634 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 18:10:47,634 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:47,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:47,634 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 18:10:47,664 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 18:10:47,664 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:47,664 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:47,665 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 18:10:47,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:47,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34171,1689703817322': 2023-07-18 18:10:47,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 18:10:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:47,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:47,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:47,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:47,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:47,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39949,1689703817554': 2023-07-18 18:10:47,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 18:10:47,676 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-18 18:10:47,676 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:10:47,676 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:10:47,676 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,676 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:10:47,710 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,710 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,711 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:47,710 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:47,710 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,710 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:47,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:47,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,711 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:47,711 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:47,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:47,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:47,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:47,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:47,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:47,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:47,712 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,712 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:47,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:47,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:47,716 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:47,716 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,716 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:47,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:47,749 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:47,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:47,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:47,749 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:47,749 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:47,750 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,749 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:47,750 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:47,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:47,749 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,749 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:47,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-18 18:10:47,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:47,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:47,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,749 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:47,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 18:10:47,752 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:47,751 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,751 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:47,752 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,752 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:47,752 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,752 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:47,752 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:47,752 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,752 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:47,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 18:10:47,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:47,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:47,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:47,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,850 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 18:10:47,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,850 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:47,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689703847286Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689703847779 (+493 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689703847779Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689703847779Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689703847798 (+19 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689703847816 (+18 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689703847850 (+34 ms) 2023-07-18 18:10:47,853 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 18:10:47,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 566 msec 2023-07-18 18:10:47,895 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:47,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:47,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:10:47,901 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39949] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:10:47,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34171] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:10:47,908 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-18 18:10:47,908 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:47,908 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:10:47,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:10:47,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703847927 (current time:1689703847927). 2023-07-18 18:10:47,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:10:47,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x0eef010b to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:48,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68ff67e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:48,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:48,007 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:48,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0eef010b to 127.0.0.1:57608 2023-07-18 18:10:48,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:48,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x2b933353 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:48,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ed12c5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:48,071 DEBUG [hconnection-0x60024712-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:48,076 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:48,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b933353 to 127.0.0.1:57608 2023-07-18 18:10:48,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:48,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 18:10:48,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:10:48,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:10:48,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:10:48,086 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:10:48,088 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689704448088 2023-07-18 18:10:48,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:10:48,088 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 18:10:48,089 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:10:48,089 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:10:48,091 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:10:48,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 18:10:48,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-18 18:10:48,094 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 18:10:48,095 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689704448095 2023-07-18 18:10:48,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-18 18:10:48,121 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-18 18:10:48,121 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:48,123 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 18:10:48,123 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 18:10:48,124 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,124 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,164 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,164 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:48,164 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:48,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:48,164 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:48,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:48,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:48,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:48,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:48,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:48,165 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,165 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,166 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,166 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:10:48,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 18:10:48,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,169 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 18:10:48,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 18:10:48,170 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 18:10:48,170 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:48,172 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 18:10:48,172 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 18:10:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 18:10:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,172 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 18:10:48,172 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 18:10:48,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 18:10:48,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,173 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 18:10:48,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 18:10:48,173 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 18:10:48,173 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:48,176 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 18:10:48,176 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 18:10:48,176 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 18:10:48,182 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 18:10:48,185 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 18:10:48,185 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:48,187 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 18:10:48,187 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 18:10:48,187 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 18:10:48,189 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:48,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:48,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:48,192 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:10:48,211 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,211 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:48,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:48,242 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,242 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,242 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:48,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:48,257 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:48,257 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:48,257 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,257 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:48,258 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,258 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:48,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:48,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 18:10:48,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@473fa00[Count = 1] remaining members to acquire global barrier 2023-07-18 18:10:48,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:48,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:48,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:48,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:48,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:48,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:48,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 18:10:48,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@473fa00[Count = 0] remaining members to acquire global barrier 2023-07-18 18:10:48,270 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 18:10:48,270 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,303 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,303 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,303 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,303 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:10:48,303 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 18:10:48,303 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,303 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:10:48,304 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:10:48,303 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:10:48,304 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:48,304 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:48,304 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:10:48,304 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,304 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:10:48,304 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. started... 2023-07-18 18:10:48,304 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:48,304 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:48,304 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:48,304 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. started... 2023-07-18 18:10:48,305 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-18 18:10:48,305 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 626973f1991d6de447a3639fa66ba64f 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-18 18:10:48,334 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 18:10:48,334 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:48,334 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 18:10:48,352 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230718f64eeb15f80148b7b7cfade830e1b82c to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230718f64eeb15f80148b7b7cfade830e1b82c 2023-07-18 18:10:48,358 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307187495ad23251748dc9ac3f01aef2317f6 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307187495ad23251748dc9ac3f01aef2317f6 2023-07-18 18:10:48,386 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/.tmp/cf/e770c70852244e4cbdc763d96bfcf6db 2023-07-18 18:10:48,390 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/.tmp/cf/b0bf2d7075994c318ed8ecfc7928a7c8 2023-07-18 18:10:48,395 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:48,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:48,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:48,398 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:10:48,400 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/.tmp/cf/e770c70852244e4cbdc763d96bfcf6db as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/cf/e770c70852244e4cbdc763d96bfcf6db 2023-07-18 18:10:48,405 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/.tmp/cf/b0bf2d7075994c318ed8ecfc7928a7c8 as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/cf/b0bf2d7075994c318ed8ecfc7928a7c8 2023-07-18 18:10:48,414 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/cf/e770c70852244e4cbdc763d96bfcf6db, entries=4, sequenceid=6, filesize=5.6 K 2023-07-18 18:10:48,414 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/cf/b0bf2d7075994c318ed8ecfc7928a7c8, entries=46, sequenceid=6, filesize=12.7 K 2023-07-18 18:10:48,415 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 626973f1991d6de447a3639fa66ba64f in 110ms, sequenceid=6, compaction requested=false 2023-07-18 18:10:48,415 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-18 18:10:48,415 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 in 111ms, sequenceid=6, compaction requested=false 2023-07-18 18:10:48,415 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-18 18:10:48,419 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 626973f1991d6de447a3639fa66ba64f: 2023-07-18 18:10:48,420 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 18:10:48,420 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:48,419 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69: 2023-07-18 18:10:48,420 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/cf/e770c70852244e4cbdc763d96bfcf6db] hfiles 2023-07-18 18:10:48,420 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/cf/e770c70852244e4cbdc763d96bfcf6db for snapshot=snaptb0-testExportFileSystemState 2023-07-18 18:10:48,420 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 18:10:48,420 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:48,420 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/cf/b0bf2d7075994c318ed8ecfc7928a7c8] hfiles 2023-07-18 18:10:48,420 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/cf/b0bf2d7075994c318ed8ecfc7928a7c8 for snapshot=snaptb0-testExportFileSystemState 2023-07-18 18:10:48,468 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. completed. 2023-07-18 18:10:48,468 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:10:48,468 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:48,468 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:48,468 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,469 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 18:10:48,469 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:10:48,470 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. completed. 2023-07-18 18:10:48,470 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:10:48,470 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:48,470 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:48,470 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,470 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 18:10:48,470 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:10:48,626 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,626 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 18:10:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:48,627 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:48,627 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 18:10:48,672 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 18:10:48,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:48,672 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:48,672 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,672 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 18:10:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:48,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:48,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39949,1689703817554': 2023-07-18 18:10:48,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 18:10:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34171,1689703817322': 2023-07-18 18:10:48,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 18:10:48,694 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-18 18:10:48,694 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:10:48,694 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:10:48,694 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-18 18:10:48,694 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:10:48,698 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:48,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:48,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:48,700 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 18:10:48,734 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,734 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,734 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,734 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:48,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,734 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:48,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,735 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,734 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:48,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,734 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:48,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:48,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:48,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:48,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:48,736 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:48,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:48,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:48,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:48,736 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:48,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:48,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:48,742 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:48,742 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:48,743 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:48,772 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:48,772 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:48,772 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,772 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,772 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:48,772 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:48,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:48,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-18 18:10:48,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:48,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-18 18:10:48,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:48,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:48,773 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:48,773 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:48,773 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:48,772 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:48,772 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:48,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:48,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:48,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:48,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:48,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 18:10:48,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:10:48,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 18:10:48,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:48,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:10:48,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:10:48,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:48,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:48,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230718f64eeb15f80148b7b7cfade830e1b82c, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307187495ad23251748dc9ac3f01aef2317f6] mob files 2023-07-18 18:10:48,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230718f64eeb15f80148b7b7cfade830e1b82c 2023-07-18 18:10:48,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307187495ad23251748dc9ac3f01aef2317f6 2023-07-18 18:10:48,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-18 18:10:48,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,829 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 18:10:48,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,830 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 18:10:48,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689703848088Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689703848786 (+698 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689703848786Loading Region manifests for snaptb0-testExportFileSystemState at 1689703848786Writing data manifest for snaptb0-testExportFileSystemState at 1689703848790 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689703848799 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689703848829 (+30 ms) 2023-07-18 18:10:48,832 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 18:10:48,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 743 msec 2023-07-18 18:10:49,200 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:49,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:49,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:10:49,201 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703849201 2023-07-18 18:10:49,202 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35301, tgtDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703849201, rawTgtDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703849201, srcFsUri=hdfs://localhost:35301, srcDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:10:49,233 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:10:49,233 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-282173358_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703849201, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703849201/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 18:10:49,233 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9, snapshotDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-18 18:10:49,244 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703849201/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 18:10:49,272 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,272 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,272 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,273 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,273 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,274 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,274 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,348 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/hadoop-4414034989308973587.jar 2023-07-18 18:10:49,349 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,349 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,350 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,350 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,350 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,351 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:49,351 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:10:49,352 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:10:49,352 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:10:49,353 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:10:49,353 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:10:49,354 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:10:49,354 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:10:49,355 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:10:49,355 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:10:49,356 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:10:49,357 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:49,357 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:49,357 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:10:49,358 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:49,358 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:49,358 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:10:49,359 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:10:50,117 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0001_000001 (auth:SIMPLE) 2023-07-18 18:10:50,735 WARN [Listener at jenkins-hbase4.apache.org/37995] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:10:50,738 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-18 18:10:50,741 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-18 18:10:50,859 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:10:50,860 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:10:50,888 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:10:51,112 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0002_000001 (auth:SIMPLE) 2023-07-18 18:10:55,845 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0002_000001 (auth:SIMPLE) 2023-07-18 18:10:58,147 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0002_000001 (auth:SIMPLE) 2023-07-18 18:11:01,095 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0002_000001 (auth:SIMPLE) 2023-07-18 18:11:02,138 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:11:02,139 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:11:02,150 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-18 18:11:02,151 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:11:02,151 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:11:02,151 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-859359611_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 18:11:02,152 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 18:11:02,152 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 18:11:02,152 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-859359611_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703849201/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703849201/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 18:11:02,153 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703849201/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 18:11:02,153 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703849201/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 18:11:02,162 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-18 18:11:02,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-18 18:11:02,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:02,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 18:11:02,169 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703862169"}]},"ts":"1689703862169"} 2023-07-18 18:11:02,171 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 18:11:02,172 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-18 18:11:02,173 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=626973f1991d6de447a3639fa66ba64f, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, UNASSIGN}] 2023-07-18 18:11:02,176 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=626973f1991d6de447a3639fa66ba64f, UNASSIGN 2023-07-18 18:11:02,176 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, UNASSIGN 2023-07-18 18:11:02,177 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=626973f1991d6de447a3639fa66ba64f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:02,177 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:02,177 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703862177"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703862177"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703862177"}]},"ts":"1689703862177"} 2023-07-18 18:11:02,178 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703862177"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703862177"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703862177"}]},"ts":"1689703862177"} 2023-07-18 18:11:02,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 626973f1991d6de447a3639fa66ba64f, server=jenkins-hbase4.apache.org,39949,1689703817554}] 2023-07-18 18:11:02,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:11:02,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 18:11:02,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 626973f1991d6de447a3639fa66ba64f 2023-07-18 18:11:02,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 626973f1991d6de447a3639fa66ba64f, disabling compactions & flushes 2023-07-18 18:11:02,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:11:02,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:11:02,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. after waiting 0 ms 2023-07-18 18:11:02,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:11:02,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:11:02,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, disabling compactions & flushes 2023-07-18 18:11:02,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:11:02,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:11:02,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. after waiting 0 ms 2023-07-18 18:11:02,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:11:02,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:11:02,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:11:02,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:02,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:02,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69. 2023-07-18 18:11:02,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f. 2023-07-18 18:11:02,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69: 2023-07-18 18:11:02,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 626973f1991d6de447a3639fa66ba64f: 2023-07-18 18:11:02,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:11:02,367 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, regionState=CLOSED 2023-07-18 18:11:02,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 626973f1991d6de447a3639fa66ba64f 2023-07-18 18:11:02,367 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703862367"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703862367"}]},"ts":"1689703862367"} 2023-07-18 18:11:02,367 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=626973f1991d6de447a3639fa66ba64f, regionState=CLOSED 2023-07-18 18:11:02,368 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703862367"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703862367"}]},"ts":"1689703862367"} 2023-07-18 18:11:02,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-18 18:11:02,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, server=jenkins-hbase4.apache.org,34171,1689703817322 in 188 msec 2023-07-18 18:11:02,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-18 18:11:02,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 626973f1991d6de447a3639fa66ba64f, server=jenkins-hbase4.apache.org,39949,1689703817554 in 190 msec 2023-07-18 18:11:02,372 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, UNASSIGN in 197 msec 2023-07-18 18:11:02,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-18 18:11:02,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=626973f1991d6de447a3639fa66ba64f, UNASSIGN in 198 msec 2023-07-18 18:11:02,374 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703862374"}]},"ts":"1689703862374"} 2023-07-18 18:11:02,375 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 18:11:02,378 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-18 18:11:02,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 216 msec 2023-07-18 18:11:02,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 18:11:02,471 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-18 18:11:02,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-18 18:11:02,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:02,475 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:02,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-18 18:11:02,476 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:02,478 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-18 18:11:02,481 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:02,481 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:02,481 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:02,481 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:02,481 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f 2023-07-18 18:11:02,482 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 18:11:02,482 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:11:02,482 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 18:11:02,482 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 18:11:02,482 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 18:11:02,482 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:02,483 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:02,483 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:02,483 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:02,483 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:02,483 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:02,483 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:02,483 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:02,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 18:11:02,484 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/recovered.edits] 2023-07-18 18:11:02,485 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/recovered.edits] 2023-07-18 18:11:02,489 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/cf/e770c70852244e4cbdc763d96bfcf6db to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/cf/e770c70852244e4cbdc763d96bfcf6db 2023-07-18 18:11:02,489 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/cf/b0bf2d7075994c318ed8ecfc7928a7c8 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/cf/b0bf2d7075994c318ed8ecfc7928a7c8 2023-07-18 18:11:02,492 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/recovered.edits/9.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f/recovered.edits/9.seqid 2023-07-18 18:11:02,493 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/recovered.edits/9.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69/recovered.edits/9.seqid 2023-07-18 18:11:02,493 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/626973f1991d6de447a3639fa66ba64f 2023-07-18 18:11:02,493 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemState/5a9a6d7b6ad53dd5b0f3a2f2be8c7a69 2023-07-18 18:11:02,493 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 18:11:02,494 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-18 18:11:02,495 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-18 18:11:02,498 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230718f64eeb15f80148b7b7cfade830e1b82c to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230718f64eeb15f80148b7b7cfade830e1b82c 2023-07-18 18:11:02,499 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307187495ad23251748dc9ac3f01aef2317f6 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307187495ad23251748dc9ac3f01aef2317f6 2023-07-18 18:11:02,500 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-18 18:11:02,502 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:02,505 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-18 18:11:02,507 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-18 18:11:02,508 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:02,508 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-18 18:11:02,509 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703862508"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:02,509 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703862508"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:02,511 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 18:11:02,511 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 626973f1991d6de447a3639fa66ba64f, NAME => 'testtb-testExportFileSystemState,,1689703845975.626973f1991d6de447a3639fa66ba64f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5a9a6d7b6ad53dd5b0f3a2f2be8c7a69, NAME => 'testtb-testExportFileSystemState,1,1689703845975.5a9a6d7b6ad53dd5b0f3a2f2be8c7a69.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 18:11:02,511 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-18 18:11:02,511 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703862511"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:02,515 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-18 18:11:02,518 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:02,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 46 msec 2023-07-18 18:11:02,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 18:11:02,586 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-18 18:11:02,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-18 18:11:02,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-18 18:11:02,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-18 18:11:02,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-18 18:11:02,628 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754 (was 748) Potentially hanging thread: Thread-2015 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:45196 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:46755 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:42978 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:37408 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1792362517_1 at /127.0.0.1:45164 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1792362517_1 at /127.0.0.1:42960 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:36843 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=403 (was 329) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2915 (was 3089) 2023-07-18 18:11:02,628 WARN [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-18 18:11:02,651 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=754, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=403, ProcessCount=183, AvailableMemoryMB=2914 2023-07-18 18:11:02,651 WARN [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-18 18:11:02,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 18:11:02,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:02,657 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:11:02,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-18 18:11:02,658 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:11:02,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 18:11:02,661 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:02,661 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:02,662 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed empty. 2023-07-18 18:11:02,662 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974 empty. 2023-07-18 18:11:02,662 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:02,663 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:02,663 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 18:11:02,681 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-18 18:11:02,682 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9263c657c6390283b9dc7b6764d0a5ed, NAME => 'testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:11:02,682 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5d0a6ea8d40de2e21916fc14e553f974, NAME => 'testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:11:02,695 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:02,695 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 9263c657c6390283b9dc7b6764d0a5ed, disabling compactions & flushes 2023-07-18 18:11:02,695 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:02,695 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:02,695 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. after waiting 0 ms 2023-07-18 18:11:02,695 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:02,695 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:02,695 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 9263c657c6390283b9dc7b6764d0a5ed: 2023-07-18 18:11:02,709 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:02,709 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 5d0a6ea8d40de2e21916fc14e553f974, disabling compactions & flushes 2023-07-18 18:11:02,710 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:02,710 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:02,710 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. after waiting 0 ms 2023-07-18 18:11:02,710 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:02,710 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:02,710 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 5d0a6ea8d40de2e21916fc14e553f974: 2023-07-18 18:11:02,712 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:11:02,715 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703862715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703862715"}]},"ts":"1689703862715"} 2023-07-18 18:11:02,715 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703862715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703862715"}]},"ts":"1689703862715"} 2023-07-18 18:11:02,719 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:11:02,720 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:11:02,720 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703862720"}]},"ts":"1689703862720"} 2023-07-18 18:11:02,722 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-18 18:11:02,726 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:11:02,727 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:11:02,727 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:11:02,727 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:11:02,727 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:11:02,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9263c657c6390283b9dc7b6764d0a5ed, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d0a6ea8d40de2e21916fc14e553f974, ASSIGN}] 2023-07-18 18:11:02,734 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d0a6ea8d40de2e21916fc14e553f974, ASSIGN 2023-07-18 18:11:02,734 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9263c657c6390283b9dc7b6764d0a5ed, ASSIGN 2023-07-18 18:11:02,735 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d0a6ea8d40de2e21916fc14e553f974, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40677,1689703817386; forceNewPlan=false, retain=false 2023-07-18 18:11:02,735 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9263c657c6390283b9dc7b6764d0a5ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39949,1689703817554; forceNewPlan=false, retain=false 2023-07-18 18:11:02,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 18:11:02,886 INFO [jenkins-hbase4:40369] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:11:02,889 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5d0a6ea8d40de2e21916fc14e553f974, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:02,889 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9263c657c6390283b9dc7b6764d0a5ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:02,889 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703862889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703862889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703862889"}]},"ts":"1689703862889"} 2023-07-18 18:11:02,889 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703862889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703862889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703862889"}]},"ts":"1689703862889"} 2023-07-18 18:11:02,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 5d0a6ea8d40de2e21916fc14e553f974, server=jenkins-hbase4.apache.org,40677,1689703817386}] 2023-07-18 18:11:02,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 9263c657c6390283b9dc7b6764d0a5ed, server=jenkins-hbase4.apache.org,39949,1689703817554}] 2023-07-18 18:11:02,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 18:11:03,045 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,045 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:11:03,049 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:11:03,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:03,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9263c657c6390283b9dc7b6764d0a5ed, NAME => 'testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 18:11:03,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. service=AccessControlService 2023-07-18 18:11:03,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:03,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:03,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:03,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:03,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:03,058 INFO [StoreOpener-9263c657c6390283b9dc7b6764d0a5ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:03,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:03,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5d0a6ea8d40de2e21916fc14e553f974, NAME => 'testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 18:11:03,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. service=AccessControlService 2023-07-18 18:11:03,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:03,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:03,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:03,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:03,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:03,071 DEBUG [StoreOpener-9263c657c6390283b9dc7b6764d0a5ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/cf 2023-07-18 18:11:03,071 DEBUG [StoreOpener-9263c657c6390283b9dc7b6764d0a5ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/cf 2023-07-18 18:11:03,071 INFO [StoreOpener-5d0a6ea8d40de2e21916fc14e553f974-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:03,072 INFO [StoreOpener-9263c657c6390283b9dc7b6764d0a5ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9263c657c6390283b9dc7b6764d0a5ed columnFamilyName cf 2023-07-18 18:11:03,075 INFO [StoreOpener-9263c657c6390283b9dc7b6764d0a5ed-1] regionserver.HStore(310): Store=9263c657c6390283b9dc7b6764d0a5ed/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:03,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:03,076 DEBUG [StoreOpener-5d0a6ea8d40de2e21916fc14e553f974-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/cf 2023-07-18 18:11:03,076 DEBUG [StoreOpener-5d0a6ea8d40de2e21916fc14e553f974-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/cf 2023-07-18 18:11:03,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:03,077 INFO [StoreOpener-5d0a6ea8d40de2e21916fc14e553f974-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d0a6ea8d40de2e21916fc14e553f974 columnFamilyName cf 2023-07-18 18:11:03,078 INFO [StoreOpener-5d0a6ea8d40de2e21916fc14e553f974-1] regionserver.HStore(310): Store=5d0a6ea8d40de2e21916fc14e553f974/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:03,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:03,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:03,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:03,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:03,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:03,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:03,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9263c657c6390283b9dc7b6764d0a5ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74718060, jitterRate=0.11338585615158081}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:03,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9263c657c6390283b9dc7b6764d0a5ed: 2023-07-18 18:11:03,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5d0a6ea8d40de2e21916fc14e553f974; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61127447, jitterRate=-0.08913005888462067}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:03,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5d0a6ea8d40de2e21916fc14e553f974: 2023-07-18 18:11:03,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed., pid=46, masterSystemTime=1689703863045 2023-07-18 18:11:03,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974., pid=45, masterSystemTime=1689703863045 2023-07-18 18:11:03,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:03,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:03,105 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9263c657c6390283b9dc7b6764d0a5ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,105 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703863105"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703863105"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703863105"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703863105"}]},"ts":"1689703863105"} 2023-07-18 18:11:03,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:03,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:03,107 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5d0a6ea8d40de2e21916fc14e553f974, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,107 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703863107"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703863107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703863107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703863107"}]},"ts":"1689703863107"} 2023-07-18 18:11:03,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-18 18:11:03,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 9263c657c6390283b9dc7b6764d0a5ed, server=jenkins-hbase4.apache.org,39949,1689703817554 in 216 msec 2023-07-18 18:11:03,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-18 18:11:03,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 5d0a6ea8d40de2e21916fc14e553f974, server=jenkins-hbase4.apache.org,40677,1689703817386 in 219 msec 2023-07-18 18:11:03,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9263c657c6390283b9dc7b6764d0a5ed, ASSIGN in 384 msec 2023-07-18 18:11:03,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-18 18:11:03,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d0a6ea8d40de2e21916fc14e553f974, ASSIGN in 385 msec 2023-07-18 18:11:03,124 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:11:03,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703863124"}]},"ts":"1689703863124"} 2023-07-18 18:11:03,126 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-18 18:11:03,128 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:11:03,129 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-18 18:11:03,131 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 18:11:03,133 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:03,133 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:03,133 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:03,134 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:03,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:03,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:03,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:03,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:03,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 483 msec 2023-07-18 18:11:03,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 18:11:03,263 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-18 18:11:03,266 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-18 18:11:03,266 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:03,267 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:03,276 DEBUG [hconnection-0x8d80b2c-shared-pool-17] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:03,282 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33168, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:03,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 18:11:03,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703863285 (current time:1689703863285). 2023-07-18 18:11:03,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:11:03,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x08d6301e to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:03,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@585ae27d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:03,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:03,295 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:03,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08d6301e to 127.0.0.1:57608 2023-07-18 18:11:03,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:03,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x3d1bb5e0 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:03,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@474249d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:03,307 DEBUG [hconnection-0xbb26764-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:03,309 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:03,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d1bb5e0 to 127.0.0.1:57608 2023-07-18 18:11:03,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:03,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 18:11:03,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:11:03,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 18:11:03,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 18:11:03,319 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 18:11:03,319 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689704463319 2023-07-18 18:11:03,320 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 18:11:03,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 18:11:03,321 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:11:03,321 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:11:03,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 18:11:03,322 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 18:11:03,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-18 18:11:03,324 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 18:11:03,325 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689704463325 2023-07-18 18:11:03,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,336 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-18 18:11:03,336 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:03,338 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 18:11:03,338 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 18:11:03,338 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,338 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,340 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:03,340 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:03,340 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:03,340 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:03,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:03,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:03,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:03,340 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:03,340 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:03,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,340 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,341 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:11:03,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 18:11:03,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 18:11:03,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 18:11:03,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 18:11:03,341 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 18:11:03,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 18:11:03,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,342 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 18:11:03,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,342 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 18:11:03,342 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 18:11:03,342 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:03,342 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:03,343 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 18:11:03,343 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 18:11:03,344 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 18:11:03,342 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:03,344 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 18:11:03,347 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 18:11:03,347 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 18:11:03,347 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 18:11:03,347 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 18:11:03,347 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 18:11:03,349 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,351 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,351 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:03,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:03,352 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,352 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,352 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,352 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,352 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:03,352 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:03,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:03,352 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,352 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:03,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:03,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:03,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 18:11:03,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@376b61ee[Count = 1] remaining members to acquire global barrier 2023-07-18 18:11:03,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:03,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:03,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 18:11:03,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@376b61ee[Count = 0] remaining members to acquire global barrier 2023-07-18 18:11:03,356 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 18:11:03,356 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,358 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,358 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,358 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,358 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,358 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 18:11:03,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,358 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 18:11:03,358 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 18:11:03,358 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 18:11:03,358 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:03,358 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:03,358 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,359 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:11:03,359 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:03,358 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:11:03,358 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:03,359 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:03,358 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:03,359 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. started... 2023-07-18 18:11:03,359 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. started... 2023-07-18 18:11:03,360 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5d0a6ea8d40de2e21916fc14e553f974: 2023-07-18 18:11:03,360 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9263c657c6390283b9dc7b6764d0a5ed: 2023-07-18 18:11:03,360 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,360 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,361 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:03,361 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:03,361 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:11:03,361 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:11:03,366 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 18:11:03,366 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:03,366 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 18:11:03,374 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. completed. 2023-07-18 18:11:03,374 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:03,374 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:03,374 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:03,374 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,374 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 18:11:03,374 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:11:03,374 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. completed. 2023-07-18 18:11:03,374 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:03,375 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:03,375 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:03,375 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,375 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 18:11:03,375 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:11:03,376 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 18:11:03,376 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,376 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:03,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:03,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:03,376 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 18:11:03,378 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,378 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 18:11:03,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:03,378 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:03,379 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 18:11:03,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:03,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:03,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40677,1689703817386': 2023-07-18 18:11:03,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 18:11:03,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:03,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:03,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:03,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:03,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:03,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39949,1689703817554': 2023-07-18 18:11:03,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 18:11:03,385 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-18 18:11:03,386 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:11:03,386 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:11:03,386 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,386 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:11:03,388 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,388 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,388 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,388 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:03,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:03,388 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:03,388 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:03,388 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:03,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:03,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:03,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,388 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:03,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:03,389 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:03,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:03,390 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:03,392 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,392 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,393 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,395 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,395 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:03,395 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:03,395 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:03,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:03,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:03,396 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:03,395 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,395 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:03,397 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:03,397 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,396 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:03,397 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-18 18:11:03,395 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:03,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:03,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 18:11:03,397 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:03,397 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:03,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:03,397 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,399 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:03,399 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,399 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,399 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 18:11:03,399 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,421 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:03,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 18:11:03,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:03,422 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:11:03,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,455 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 18:11:03,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,456 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:03,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689703863320Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689703863412 (+92 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689703863412Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689703863412Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689703863419 (+7 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689703863430 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689703863455 (+25 ms) 2023-07-18 18:11:03,458 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 18:11:03,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 137 msec 2023-07-18 18:11:03,622 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:03,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 18:11:03,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:11:03,626 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39949] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:11:03,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40677] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:11:03,631 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-18 18:11:03,631 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:03,631 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:03,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 18:11:03,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703863643 (current time:1689703863643). 2023-07-18 18:11:03,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:11:03,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x6c149fd7 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:03,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d388439, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:03,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:03,657 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:03,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c149fd7 to 127.0.0.1:57608 2023-07-18 18:11:03,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:03,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x5bdb4012 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:03,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13f98699, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:03,669 DEBUG [hconnection-0x1ae9c193-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:03,672 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:03,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bdb4012 to 127.0.0.1:57608 2023-07-18 18:11:03,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:03,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 18:11:03,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:11:03,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 18:11:03,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 18:11:03,683 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 18:11:03,684 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689704463684 2023-07-18 18:11:03,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 18:11:03,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 18:11:03,685 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:11:03,685 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:11:03,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 18:11:03,687 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 18:11:03,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-18 18:11:03,689 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 18:11:03,690 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689704463690 2023-07-18 18:11:03,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-18 18:11:03,699 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-18 18:11:03,699 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:03,701 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 18:11:03,701 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 18:11:03,701 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,701 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,703 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,703 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:03,703 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:03,703 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:03,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:03,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:03,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:03,703 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,703 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,704 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,704 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:11:03,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 18:11:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 18:11:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,704 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 18:11:03,704 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 18:11:03,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 18:11:03,705 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 18:11:03,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 18:11:03,705 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:03,705 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 18:11:03,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 18:11:03,706 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:03,706 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 18:11:03,707 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 18:11:03,707 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 18:11:03,707 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 18:11:03,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,708 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 18:11:03,707 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 18:11:03,708 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 18:11:03,708 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 18:11:03,708 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 18:11:03,708 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:03,709 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 18:11:03,709 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 18:11:03,709 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 18:11:03,711 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,711 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,711 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:03,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:03,711 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,713 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:03,714 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,714 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:03,714 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,714 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:03,714 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,714 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:03,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 18:11:03,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50e6cbc9[Count = 1] remaining members to acquire global barrier 2023-07-18 18:11:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:03,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:03,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:03,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 18:11:03,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50e6cbc9[Count = 0] remaining members to acquire global barrier 2023-07-18 18:11:03,718 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 18:11:03,718 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,719 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,719 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,719 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,719 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 18:11:03,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,720 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 18:11:03,720 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:03,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:03,720 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. started... 2023-07-18 18:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 18:11:03,720 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,720 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 18:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:03,720 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:03,720 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. started... 2023-07-18 18:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:03,720 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:11:03,720 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9263c657c6390283b9dc7b6764d0a5ed 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-18 18:11:03,720 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5d0a6ea8d40de2e21916fc14e553f974 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-18 18:11:03,722 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 18:11:03,722 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:03,722 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 18:11:03,741 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071809eeef0e4a4c48dea731d5b2723f9c0a to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071809eeef0e4a4c48dea731d5b2723f9c0a 2023-07-18 18:11:03,741 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307181ecc6e0b36b649b785a1c25e9222644a to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307181ecc6e0b36b649b785a1c25e9222644a 2023-07-18 18:11:03,755 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/.tmp/cf/5a84b4c917054a268574a1ff8a1d636a 2023-07-18 18:11:03,758 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/.tmp/cf/aef797191c614d75a7d6d449e5f5d0db 2023-07-18 18:11:03,761 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/.tmp/cf/5a84b4c917054a268574a1ff8a1d636a as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/cf/5a84b4c917054a268574a1ff8a1d636a 2023-07-18 18:11:03,767 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/.tmp/cf/aef797191c614d75a7d6d449e5f5d0db as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/cf/aef797191c614d75a7d6d449e5f5d0db 2023-07-18 18:11:03,770 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/cf/5a84b4c917054a268574a1ff8a1d636a, entries=2, sequenceid=6, filesize=5.2 K 2023-07-18 18:11:03,771 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 9263c657c6390283b9dc7b6764d0a5ed in 51ms, sequenceid=6, compaction requested=false 2023-07-18 18:11:03,771 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-18 18:11:03,772 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9263c657c6390283b9dc7b6764d0a5ed: 2023-07-18 18:11:03,772 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 18:11:03,772 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:03,772 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/cf/5a84b4c917054a268574a1ff8a1d636a] hfiles 2023-07-18 18:11:03,772 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/cf/5a84b4c917054a268574a1ff8a1d636a for snapshot=snaptb0-testConsecutiveExports 2023-07-18 18:11:03,773 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/cf/aef797191c614d75a7d6d449e5f5d0db, entries=48, sequenceid=6, filesize=12.9 K 2023-07-18 18:11:03,774 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 5d0a6ea8d40de2e21916fc14e553f974 in 54ms, sequenceid=6, compaction requested=false 2023-07-18 18:11:03,775 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5d0a6ea8d40de2e21916fc14e553f974: 2023-07-18 18:11:03,775 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 18:11:03,775 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:03,775 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/cf/aef797191c614d75a7d6d449e5f5d0db] hfiles 2023-07-18 18:11:03,775 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/cf/aef797191c614d75a7d6d449e5f5d0db for snapshot=snaptb0-testConsecutiveExports 2023-07-18 18:11:03,786 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:03,786 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. completed. 2023-07-18 18:11:03,787 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:03,787 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:03,787 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:03,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 18:11:03,787 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:03,787 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 18:11:03,787 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:11:03,787 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:11:03,789 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 18:11:03,789 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:03,789 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,789 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 18:11:03,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:03,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:03,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:03,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:03,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:03,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:03,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:03,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39949,1689703817554': 2023-07-18 18:11:03,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 18:11:03,987 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:03,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 18:11:03,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:03,989 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:11:04,184 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. completed. 2023-07-18 18:11:04,184 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:04,184 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:04,184 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:04,184 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:04,184 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 18:11:04,184 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:11:04,187 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:04,187 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 18:11:04,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:04,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:04,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:04,187 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:04,187 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 18:11:04,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:04,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:04,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:04,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:04,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:04,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:04,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:04,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40677,1689703817386': 2023-07-18 18:11:04,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 18:11:04,192 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-18 18:11:04,192 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:11:04,192 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:11:04,192 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-18 18:11:04,192 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:11:04,194 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,194 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,194 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,194 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:04,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,194 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:04,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:04,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:04,194 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:04,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,194 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:04,194 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:04,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:04,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:04,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:04,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:04,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:04,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:04,195 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:04,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:04,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,195 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:04,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:04,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:04,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:04,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:04,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:04,197 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:04,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:04,198 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:04,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:04,198 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:04,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:04,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:04,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:04,204 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:04,204 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,204 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:04,204 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:04,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:04,204 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:04,204 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:04,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:04,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:04,204 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:04,204 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:04,205 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:04,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:04,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-18 18:11:04,205 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-18 18:11:04,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:04,204 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:04,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:04,204 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:04,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:04,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 18:11:04,205 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 18:11:04,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:04,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:04,207 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:04,207 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,207 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:04,207 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:04,207 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,207 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:04,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:04,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307181ecc6e0b36b649b785a1c25e9222644a, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071809eeef0e4a4c48dea731d5b2723f9c0a] mob files 2023-07-18 18:11:04,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307181ecc6e0b36b649b785a1c25e9222644a 2023-07-18 18:11:04,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071809eeef0e4a4c48dea731d5b2723f9c0a 2023-07-18 18:11:04,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-18 18:11:04,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,259 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 18:11:04,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,260 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689703863684Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689703864216 (+532 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689703864216Loading Region manifests for snaptb0-testConsecutiveExports at 1689703864216Writing data manifest for snaptb0-testConsecutiveExports at 1689703864223 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689703864234 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689703864259 (+25 ms) 2023-07-18 18:11:04,262 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 18:11:04,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 577 msec 2023-07-18 18:11:04,289 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:04,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 18:11:04,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:11:04,290 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290 2023-07-18 18:11:04,291 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290, srcFsUri=hdfs://localhost:35301, srcDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:11:04,314 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:11:04,315 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@331b899a, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,315 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9, snapshotDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 18:11:04,324 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:04,337 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,338 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,338 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,339 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,339 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,340 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,340 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,419 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/hadoop-5509288034595492534.jar 2023-07-18 18:11:04,419 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,419 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,420 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,420 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,420 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,421 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:04,421 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:11:04,422 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:11:04,422 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:11:04,422 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:11:04,423 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:11:04,423 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:11:04,423 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:11:04,424 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:11:04,424 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:11:04,424 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:11:04,425 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:04,425 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:04,426 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:04,426 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:04,426 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:04,426 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:04,427 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:06,074 WARN [Listener at jenkins-hbase4.apache.org/37995] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:11:06,083 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 18:11:06,085 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-18 18:11:07,280 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:11:07,280 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:11:07,286 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0002_000001 (auth:SIMPLE) 2023-07-18 18:11:07,578 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0003_000001 (auth:SIMPLE) 2023-07-18 18:11:07,964 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:11:12,077 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0003_000001 (auth:SIMPLE) 2023-07-18 18:11:14,336 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0003_000001 (auth:SIMPLE) 2023-07-18 18:11:17,499 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0003_000001 (auth:SIMPLE) 2023-07-18 18:11:19,499 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:11:19,500 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:11:19,504 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 18:11:19,504 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:11:19,505 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:11:19,505 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-859359611_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 18:11:19,507 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 18:11:19,507 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 18:11:19,507 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@158cb81c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 18:11:19,508 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 18:11:19,508 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 18:11:19,509 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290, srcFsUri=hdfs://localhost:35301, srcDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:11:19,530 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:11:19,531 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4d65ca21, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:19,531 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9, snapshotDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 18:11:19,543 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:19,555 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,556 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,556 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,557 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,557 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,557 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,557 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,627 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/hadoop-5852370413456272025.jar 2023-07-18 18:11:19,627 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,628 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,628 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,628 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,629 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,629 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:19,629 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:11:19,630 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:11:19,630 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:11:19,631 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:11:19,631 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:11:19,631 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:11:19,632 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:11:19,632 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:11:19,632 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:11:19,633 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:11:19,633 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:19,634 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:19,634 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:19,634 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:19,634 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:19,635 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:19,635 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:20,017 WARN [Listener at jenkins-hbase4.apache.org/37995] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:11:20,019 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 18:11:20,021 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-18 18:11:23,610 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:11:23,611 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:11:23,613 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0003_000001 (auth:SIMPLE) 2023-07-18 18:11:24,507 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0004_000001 (auth:SIMPLE) 2023-07-18 18:11:28,978 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0004_000001 (auth:SIMPLE) 2023-07-18 18:11:31,267 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0004_000001 (auth:SIMPLE) 2023-07-18 18:11:34,664 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0004_000001 (auth:SIMPLE) 2023-07-18 18:11:36,303 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:11:36,304 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:11:36,319 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 18:11:36,319 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:11:36,320 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:11:36,320 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-859359611_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 18:11:36,323 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 18:11:36,323 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 18:11:36,323 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@158cb81c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 18:11:36,324 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 18:11:36,324 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/local-export-1689703864290/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 18:11:36,342 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-18 18:11:36,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-18 18:11:36,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:36,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 18:11:36,350 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703896350"}]},"ts":"1689703896350"} 2023-07-18 18:11:36,352 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-18 18:11:36,354 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-18 18:11:36,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9263c657c6390283b9dc7b6764d0a5ed, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d0a6ea8d40de2e21916fc14e553f974, UNASSIGN}] 2023-07-18 18:11:36,356 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d0a6ea8d40de2e21916fc14e553f974, UNASSIGN 2023-07-18 18:11:36,358 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9263c657c6390283b9dc7b6764d0a5ed, UNASSIGN 2023-07-18 18:11:36,359 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5d0a6ea8d40de2e21916fc14e553f974, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:36,359 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=9263c657c6390283b9dc7b6764d0a5ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:36,359 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703896359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703896359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703896359"}]},"ts":"1689703896359"} 2023-07-18 18:11:36,360 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703896359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703896359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703896359"}]},"ts":"1689703896359"} 2023-07-18 18:11:36,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 5d0a6ea8d40de2e21916fc14e553f974, server=jenkins-hbase4.apache.org,40677,1689703817386}] 2023-07-18 18:11:36,363 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 9263c657c6390283b9dc7b6764d0a5ed, server=jenkins-hbase4.apache.org,39949,1689703817554}] 2023-07-18 18:11:36,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 18:11:36,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:36,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5d0a6ea8d40de2e21916fc14e553f974, disabling compactions & flushes 2023-07-18 18:11:36,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:36,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:36,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. after waiting 0 ms 2023-07-18 18:11:36,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:36,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9263c657c6390283b9dc7b6764d0a5ed, disabling compactions & flushes 2023-07-18 18:11:36,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. after waiting 0 ms 2023-07-18 18:11:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:36,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:11:36,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:11:36,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:36,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed. 2023-07-18 18:11:36,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:36,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9263c657c6390283b9dc7b6764d0a5ed: 2023-07-18 18:11:36,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974. 2023-07-18 18:11:36,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5d0a6ea8d40de2e21916fc14e553f974: 2023-07-18 18:11:36,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:36,545 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=9263c657c6390283b9dc7b6764d0a5ed, regionState=CLOSED 2023-07-18 18:11:36,545 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703896545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703896545"}]},"ts":"1689703896545"} 2023-07-18 18:11:36,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:36,546 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5d0a6ea8d40de2e21916fc14e553f974, regionState=CLOSED 2023-07-18 18:11:36,546 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703896546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703896546"}]},"ts":"1689703896546"} 2023-07-18 18:11:36,549 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-18 18:11:36,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 9263c657c6390283b9dc7b6764d0a5ed, server=jenkins-hbase4.apache.org,39949,1689703817554 in 184 msec 2023-07-18 18:11:36,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-18 18:11:36,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9263c657c6390283b9dc7b6764d0a5ed, UNASSIGN in 195 msec 2023-07-18 18:11:36,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 5d0a6ea8d40de2e21916fc14e553f974, server=jenkins-hbase4.apache.org,40677,1689703817386 in 187 msec 2023-07-18 18:11:36,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-18 18:11:36,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d0a6ea8d40de2e21916fc14e553f974, UNASSIGN in 196 msec 2023-07-18 18:11:36,563 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703896563"}]},"ts":"1689703896563"} 2023-07-18 18:11:36,565 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-18 18:11:36,568 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-18 18:11:36,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 226 msec 2023-07-18 18:11:36,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 18:11:36,652 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-18 18:11:36,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-18 18:11:36,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:36,657 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:36,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-18 18:11:36,659 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-18 18:11:36,661 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:36,668 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:36,668 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:36,668 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:36,668 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:36,669 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 18:11:36,669 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 18:11:36,669 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 18:11:36,669 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 18:11:36,672 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:36,672 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:36,672 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:36,672 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:36,672 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:36,672 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:36,672 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:36,672 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:36,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 18:11:36,676 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:36,676 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:36,680 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/recovered.edits] 2023-07-18 18:11:36,685 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/recovered.edits] 2023-07-18 18:11:36,686 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/cf/5a84b4c917054a268574a1ff8a1d636a to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/cf/5a84b4c917054a268574a1ff8a1d636a 2023-07-18 18:11:36,691 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/cf/aef797191c614d75a7d6d449e5f5d0db to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/cf/aef797191c614d75a7d6d449e5f5d0db 2023-07-18 18:11:36,691 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/recovered.edits/9.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed/recovered.edits/9.seqid 2023-07-18 18:11:36,691 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/9263c657c6390283b9dc7b6764d0a5ed 2023-07-18 18:11:36,696 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/recovered.edits/9.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974/recovered.edits/9.seqid 2023-07-18 18:11:36,697 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testConsecutiveExports/5d0a6ea8d40de2e21916fc14e553f974 2023-07-18 18:11:36,697 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 18:11:36,697 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-18 18:11:36,699 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-18 18:11:36,705 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307181ecc6e0b36b649b785a1c25e9222644a to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307181ecc6e0b36b649b785a1c25e9222644a 2023-07-18 18:11:36,706 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071809eeef0e4a4c48dea731d5b2723f9c0a to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071809eeef0e4a4c48dea731d5b2723f9c0a 2023-07-18 18:11:36,707 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-18 18:11:36,711 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:36,730 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-18 18:11:36,754 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-18 18:11:36,756 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:36,756 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-18 18:11:36,756 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703896756"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:36,757 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703896756"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:36,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 18:11:36,780 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 18:11:36,781 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9263c657c6390283b9dc7b6764d0a5ed, NAME => 'testtb-testConsecutiveExports,,1689703862653.9263c657c6390283b9dc7b6764d0a5ed.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5d0a6ea8d40de2e21916fc14e553f974, NAME => 'testtb-testConsecutiveExports,1,1689703862653.5d0a6ea8d40de2e21916fc14e553f974.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 18:11:36,781 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-18 18:11:36,781 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703896781"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:36,787 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-18 18:11:36,845 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:36,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 192 msec 2023-07-18 18:11:36,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 18:11:36,981 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-18 18:11:36,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-18 18:11:36,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:37,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-18 18:11:37,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-18 18:11:37,095 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 754), OpenFileDescriptor=896 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=476 (was 403) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2559 (was 2914) 2023-07-18 18:11:37,095 WARN [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-18 18:11:37,125 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=476, ProcessCount=187, AvailableMemoryMB=2558 2023-07-18 18:11:37,125 WARN [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-18 18:11:37,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 18:11:37,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,132 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:11:37,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-18 18:11:37,133 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:11:37,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 18:11:37,135 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:11:37,139 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6 empty. 2023-07-18 18:11:37,139 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:11:37,139 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:11:37,139 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e empty. 2023-07-18 18:11:37,140 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:11:37,140 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 18:11:37,159 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-18 18:11:37,161 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => d6cb3eb339c61a767221a2bf2842129e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:11:37,161 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => e42e9e01dd314afad9f2ffb4149d28d6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:11:37,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 18:11:37,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:37,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing e42e9e01dd314afad9f2ffb4149d28d6, disabling compactions & flushes 2023-07-18 18:11:37,270 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:37,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:37,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. after waiting 0 ms 2023-07-18 18:11:37,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:37,270 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:37,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for e42e9e01dd314afad9f2ffb4149d28d6: 2023-07-18 18:11:37,364 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:37,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing d6cb3eb339c61a767221a2bf2842129e, disabling compactions & flushes 2023-07-18 18:11:37,365 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:11:37,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:11:37,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. after waiting 0 ms 2023-07-18 18:11:37,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:11:37,365 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:11:37,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for d6cb3eb339c61a767221a2bf2842129e: 2023-07-18 18:11:37,371 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:11:37,372 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703897371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703897371"}]},"ts":"1689703897371"} 2023-07-18 18:11:37,372 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703897371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703897371"}]},"ts":"1689703897371"} 2023-07-18 18:11:37,378 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:11:37,409 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:11:37,409 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703897409"}]},"ts":"1689703897409"} 2023-07-18 18:11:37,433 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-18 18:11:37,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 18:11:37,546 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:11:37,547 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:11:37,547 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:11:37,547 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:11:37,548 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:11:37,548 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e42e9e01dd314afad9f2ffb4149d28d6, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d6cb3eb339c61a767221a2bf2842129e, ASSIGN}] 2023-07-18 18:11:37,552 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d6cb3eb339c61a767221a2bf2842129e, ASSIGN 2023-07-18 18:11:37,552 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e42e9e01dd314afad9f2ffb4149d28d6, ASSIGN 2023-07-18 18:11:37,553 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d6cb3eb339c61a767221a2bf2842129e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34171,1689703817322; forceNewPlan=false, retain=false 2023-07-18 18:11:37,553 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e42e9e01dd314afad9f2ffb4149d28d6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40677,1689703817386; forceNewPlan=false, retain=false 2023-07-18 18:11:37,706 INFO [jenkins-hbase4:40369] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:11:37,709 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=d6cb3eb339c61a767221a2bf2842129e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:37,709 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e42e9e01dd314afad9f2ffb4149d28d6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:37,709 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703897709"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703897709"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703897709"}]},"ts":"1689703897709"} 2023-07-18 18:11:37,709 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703897709"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703897709"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703897709"}]},"ts":"1689703897709"} 2023-07-18 18:11:37,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure d6cb3eb339c61a767221a2bf2842129e, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:11:37,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure e42e9e01dd314afad9f2ffb4149d28d6, server=jenkins-hbase4.apache.org,40677,1689703817386}] 2023-07-18 18:11:37,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 18:11:37,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:11:37,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d6cb3eb339c61a767221a2bf2842129e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 18:11:37,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. service=AccessControlService 2023-07-18 18:11:37,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:37,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:37,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:11:37,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:37,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e42e9e01dd314afad9f2ffb4149d28d6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 18:11:37,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:11:37,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:11:37,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. service=AccessControlService 2023-07-18 18:11:37,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:37,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:11:37,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:37,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:11:37,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:11:37,872 INFO [StoreOpener-d6cb3eb339c61a767221a2bf2842129e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:11:37,873 INFO [StoreOpener-e42e9e01dd314afad9f2ffb4149d28d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:11:37,874 DEBUG [StoreOpener-d6cb3eb339c61a767221a2bf2842129e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/cf 2023-07-18 18:11:37,874 DEBUG [StoreOpener-e42e9e01dd314afad9f2ffb4149d28d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/cf 2023-07-18 18:11:37,874 DEBUG [StoreOpener-d6cb3eb339c61a767221a2bf2842129e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/cf 2023-07-18 18:11:37,874 DEBUG [StoreOpener-e42e9e01dd314afad9f2ffb4149d28d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/cf 2023-07-18 18:11:37,875 INFO [StoreOpener-e42e9e01dd314afad9f2ffb4149d28d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e42e9e01dd314afad9f2ffb4149d28d6 columnFamilyName cf 2023-07-18 18:11:37,875 INFO [StoreOpener-d6cb3eb339c61a767221a2bf2842129e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6cb3eb339c61a767221a2bf2842129e columnFamilyName cf 2023-07-18 18:11:37,877 INFO [StoreOpener-d6cb3eb339c61a767221a2bf2842129e-1] regionserver.HStore(310): Store=d6cb3eb339c61a767221a2bf2842129e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:37,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:11:37,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:11:37,879 INFO [StoreOpener-e42e9e01dd314afad9f2ffb4149d28d6-1] regionserver.HStore(310): Store=e42e9e01dd314afad9f2ffb4149d28d6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:37,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:11:37,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:11:37,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:11:37,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:37,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d6cb3eb339c61a767221a2bf2842129e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68326903, jitterRate=0.018150195479393005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:37,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:11:37,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d6cb3eb339c61a767221a2bf2842129e: 2023-07-18 18:11:37,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e., pid=60, masterSystemTime=1689703897863 2023-07-18 18:11:37,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:37,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:11:37,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e42e9e01dd314afad9f2ffb4149d28d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72245749, jitterRate=0.07654555141925812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:37,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:11:37,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e42e9e01dd314afad9f2ffb4149d28d6: 2023-07-18 18:11:37,887 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=d6cb3eb339c61a767221a2bf2842129e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:37,887 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703897887"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703897887"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703897887"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703897887"}]},"ts":"1689703897887"} 2023-07-18 18:11:37,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6., pid=61, masterSystemTime=1689703897864 2023-07-18 18:11:37,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:37,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:37,889 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e42e9e01dd314afad9f2ffb4149d28d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:37,890 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703897889"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703897889"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703897889"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703897889"}]},"ts":"1689703897889"} 2023-07-18 18:11:37,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-18 18:11:37,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure d6cb3eb339c61a767221a2bf2842129e, server=jenkins-hbase4.apache.org,34171,1689703817322 in 178 msec 2023-07-18 18:11:37,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d6cb3eb339c61a767221a2bf2842129e, ASSIGN in 343 msec 2023-07-18 18:11:37,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-18 18:11:37,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure e42e9e01dd314afad9f2ffb4149d28d6, server=jenkins-hbase4.apache.org,40677,1689703817386 in 179 msec 2023-07-18 18:11:37,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-18 18:11:37,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e42e9e01dd314afad9f2ffb4149d28d6, ASSIGN in 346 msec 2023-07-18 18:11:37,896 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:11:37,896 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703897896"}]},"ts":"1689703897896"} 2023-07-18 18:11:37,897 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-18 18:11:37,907 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:11:37,908 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-18 18:11:37,909 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 18:11:37,922 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:37,922 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:37,922 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:37,922 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:37,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:37,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:37,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:37,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:37,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 826 msec 2023-07-18 18:11:38,058 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-18 18:11:38,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 18:11:38,239 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-18 18:11:38,242 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,242 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:38,245 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:38,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 18:11:38,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703898267 (current time:1689703898267). 2023-07-18 18:11:38,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:11:38,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x670d819a to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:38,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d21959, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:38,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:38,291 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:38,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x670d819a to 127.0.0.1:57608 2023-07-18 18:11:38,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:38,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x1917d1b0 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:38,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@121d9259, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:38,309 DEBUG [hconnection-0x3144992-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:38,311 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:38,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1917d1b0 to 127.0.0.1:57608 2023-07-18 18:11:38,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:38,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 18:11:38,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:11:38,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 18:11:38,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 18:11:38,323 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 18:11:38,324 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689704498324 2023-07-18 18:11:38,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 18:11:38,324 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,327 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:11:38,327 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:11:38,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 18:11:38,333 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 18:11:38,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 12 msec 2023-07-18 18:11:38,336 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 18:11:38,337 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689704498337 2023-07-18 18:11:38,427 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:38,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:38,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:38,429 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:11:38,629 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:38,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:38,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:38,630 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:11:38,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,758 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 18:11:38,758 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:38,758 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 18:11:38,758 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 18:11:38,758 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,758 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,759 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:38,759 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,759 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:38,759 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:38,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:38,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:38,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:38,760 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,760 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,760 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,760 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:11:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 18:11:38,761 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 18:11:38,761 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:38,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,763 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 18:11:38,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,763 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 18:11:38,763 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 18:11:38,763 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:38,763 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 18:11:38,764 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 18:11:38,764 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 18:11:38,764 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 18:11:38,763 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:38,764 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 18:11:38,765 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 18:11:38,765 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 18:11:38,765 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 18:11:38,766 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,766 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,766 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,767 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:38,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:38,767 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,767 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,767 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:38,767 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,767 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:38,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:38,767 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,767 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:38,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:38,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:38,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:38,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 18:11:38,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b295865[Count = 1] remaining members to acquire global barrier 2023-07-18 18:11:38,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:38,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:38,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:38,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:38,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:38,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:38,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 18:11:38,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b295865[Count = 0] remaining members to acquire global barrier 2023-07-18 18:11:38,771 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 18:11:38,771 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,773 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,773 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,773 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,773 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 18:11:38,773 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,773 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 18:11:38,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,773 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:11:38,773 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 18:11:38,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,773 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,774 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:11:38,773 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 18:11:38,774 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:38,774 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:38,774 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:11:38,774 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:38,774 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:38,774 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. started... 2023-07-18 18:11:38,774 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. started... 2023-07-18 18:11:38,774 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:38,775 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e42e9e01dd314afad9f2ffb4149d28d6: 2023-07-18 18:11:38,775 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d6cb3eb339c61a767221a2bf2842129e: 2023-07-18 18:11:38,775 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,775 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,775 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:38,775 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:38,776 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:11:38,776 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:11:38,779 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 18:11:38,780 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:38,780 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 18:11:38,785 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. completed. 2023-07-18 18:11:38,785 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:38,785 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:38,785 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:38,785 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,786 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. completed. 2023-07-18 18:11:38,786 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:11:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 18:11:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:11:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 18:11:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:11:38,787 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 18:11:38,787 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,787 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 18:11:38,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:38,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:38,788 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:38,787 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,787 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:38,788 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 18:11:38,789 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 18:11:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40677,1689703817386': 2023-07-18 18:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 18:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:38,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:38,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34171,1689703817322': 2023-07-18 18:11:38,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 18:11:38,796 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 18:11:38,796 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:11:38,796 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:11:38,797 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,797 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:11:38,798 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,798 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,798 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,798 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:38,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,799 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:38,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,798 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:38,798 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:38,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:38,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:38,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:38,799 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,800 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:38,800 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:38,802 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:38,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,802 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:38,802 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,805 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,805 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:38,805 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:38,805 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:38,805 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:38,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:38,807 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:38,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:38,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:38,805 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:38,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,805 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:38,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:38,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:38,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:38,807 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:38,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:38,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:38,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 18:11:38,807 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:38,808 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:38,808 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,808 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:38,808 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,808 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:38,808 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:38,808 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:38,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:38,808 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 18:11:38,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,867 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 18:11:38,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,867 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689703898324Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689703898815 (+491 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689703898815Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689703898815Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689703898819 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689703898827 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689703898867 (+40 ms) 2023-07-18 18:11:38,870 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 18:11:38,872 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 545 msec 2023-07-18 18:11:38,930 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:38,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:38,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:11:38,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40677] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:11:38,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34171] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:11:38,938 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,939 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:38,939 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:38,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 18:11:38,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703898951 (current time:1689703898951). 2023-07-18 18:11:38,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:11:38,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x686c118a to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:38,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34f6e952, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:38,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:38,965 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:38,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x686c118a to 127.0.0.1:57608 2023-07-18 18:11:38,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:38,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x44e82e32 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:38,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c808764, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:38,982 DEBUG [hconnection-0x4f3f5bdf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:38,985 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:38,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44e82e32 to 127.0.0.1:57608 2023-07-18 18:11:38,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:38,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 18:11:38,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:11:38,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 18:11:38,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 18:11:38,997 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 18:11:38,998 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689704498998 2023-07-18 18:11:38,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:38,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 18:11:39,000 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:11:39,000 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:11:39,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 18:11:39,002 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 18:11:39,003 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-18 18:11:39,004 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 18:11:39,005 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689704499005 2023-07-18 18:11:39,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,019 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 18:11:39,020 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:39,021 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 18:11:39,021 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 18:11:39,096 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,096 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,098 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:39,098 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:39,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:39,098 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,098 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:39,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:39,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:39,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:39,099 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,099 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,099 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,099 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:11:39,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 18:11:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 18:11:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 18:11:39,100 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 18:11:39,100 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,100 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 18:11:39,101 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 18:11:39,100 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 18:11:39,101 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:39,102 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 18:11:39,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,102 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 18:11:39,102 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:39,102 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 18:11:39,103 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 18:11:39,102 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 18:11:39,104 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 18:11:39,103 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 18:11:39,104 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 18:11:39,104 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 18:11:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 18:11:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 18:11:39,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:39,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:39,106 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:11:39,107 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,107 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:39,108 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,108 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:39,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:39,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:39,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 18:11:39,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@509108fa[Count = 1] remaining members to acquire global barrier 2023-07-18 18:11:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:39,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 18:11:39,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@509108fa[Count = 0] remaining members to acquire global barrier 2023-07-18 18:11:39,112 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 18:11:39,112 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,113 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,113 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,113 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,114 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 18:11:39,114 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,114 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:39,114 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:39,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,114 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,114 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:11:39,114 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 18:11:39,114 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:39,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,114 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:39,114 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. started... 2023-07-18 18:11:39,114 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:11:39,114 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 18:11:39,114 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. started... 2023-07-18 18:11:39,114 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:39,114 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e42e9e01dd314afad9f2ffb4149d28d6 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 18:11:39,114 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 18:11:39,115 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:11:39,115 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d6cb3eb339c61a767221a2bf2842129e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 18:11:39,123 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 18:11:39,123 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:39,123 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 18:11:39,185 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230718974974c2ed64422982086925ba829613 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718974974c2ed64422982086925ba829613 2023-07-18 18:11:39,187 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230718ac3f9eefc3b3408b9c439451d2162f75 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230718ac3f9eefc3b3408b9c439451d2162f75 2023-07-18 18:11:39,219 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/.tmp/cf/baffb8d3590841b39a0c482a3bc31089 2023-07-18 18:11:39,229 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/.tmp/cf/baffb8d3590841b39a0c482a3bc31089 as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/cf/baffb8d3590841b39a0c482a3bc31089 2023-07-18 18:11:39,237 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/cf/baffb8d3590841b39a0c482a3bc31089, entries=3, sequenceid=6, filesize=5.4 K 2023-07-18 18:11:39,238 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for e42e9e01dd314afad9f2ffb4149d28d6 in 124ms, sequenceid=6, compaction requested=false 2023-07-18 18:11:39,240 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e42e9e01dd314afad9f2ffb4149d28d6: 2023-07-18 18:11:39,240 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,241 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:39,241 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/cf/baffb8d3590841b39a0c482a3bc31089] hfiles 2023-07-18 18:11:39,241 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/cf/baffb8d3590841b39a0c482a3bc31089 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,244 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/.tmp/cf/1bda24282ffa4c589d1d4d242baae4a9 2023-07-18 18:11:39,251 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/.tmp/cf/1bda24282ffa4c589d1d4d242baae4a9 as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/cf/1bda24282ffa4c589d1d4d242baae4a9 2023-07-18 18:11:39,256 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/cf/1bda24282ffa4c589d1d4d242baae4a9, entries=47, sequenceid=6, filesize=13.5 K 2023-07-18 18:11:39,258 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for d6cb3eb339c61a767221a2bf2842129e in 143ms, sequenceid=6, compaction requested=false 2023-07-18 18:11:39,258 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d6cb3eb339c61a767221a2bf2842129e: 2023-07-18 18:11:39,258 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,258 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:39,258 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/cf/1bda24282ffa4c589d1d4d242baae4a9] hfiles 2023-07-18 18:11:39,258 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/cf/1bda24282ffa4c589d1d4d242baae4a9 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,273 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. completed. 2023-07-18 18:11:39,273 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:11:39,273 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:39,273 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:39,273 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,273 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 18:11:39,273 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:11:39,276 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,276 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 18:11:39,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:39,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:39,276 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:39,277 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 18:11:39,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:39,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:39,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:39,302 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. completed. 2023-07-18 18:11:39,302 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:11:39,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,302 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:39,303 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:39,303 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,303 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 18:11:39,303 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:11:39,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:39,304 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,304 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 18:11:39,304 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:39,304 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 18:11:39,306 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:39,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:39,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:39,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:39,308 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:11:39,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40677,1689703817386': 2023-07-18 18:11:39,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 18:11:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:39,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:39,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:39,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:39,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:39,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34171,1689703817322': 2023-07-18 18:11:39,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 18:11:39,315 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 18:11:39,315 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:11:39,315 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:11:39,315 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,315 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:11:39,320 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,321 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,321 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,321 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:39,321 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,321 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:39,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:39,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:39,321 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,322 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:39,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:39,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:39,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:39,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:39,322 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:39,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,323 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:39,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:39,325 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:39,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,326 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:39,326 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:39,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,337 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:39,337 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:39,337 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:39,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:39,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:39,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:39,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:39,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:39,337 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:39,337 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:39,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:39,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:39,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:39,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:39,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:39,338 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:39,338 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:39,339 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:39,339 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:39,339 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,339 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,339 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,339 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,340 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,340 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:39,340 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,340 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,340 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:39,340 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,342 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 18:11:39,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230718ac3f9eefc3b3408b9c439451d2162f75, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718974974c2ed64422982086925ba829613] mob files 2023-07-18 18:11:39,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230718ac3f9eefc3b3408b9c439451d2162f75 2023-07-18 18:11:39,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718974974c2ed64422982086925ba829613 2023-07-18 18:11:39,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,458 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 18:11:39,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,459 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:39,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689703898998Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689703899365 (+367 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689703899365Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689703899365Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689703899370 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689703899417 (+47 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689703899458 (+41 ms) 2023-07-18 18:11:39,462 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 18:11:39,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 463 msec 2023-07-18 18:11:39,608 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:39,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:39,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:11:39,650 DEBUG [Listener at jenkins-hbase4.apache.org/37995] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:11:39,655 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:11:39,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34171] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 18:11:39,657 DEBUG [Listener at jenkins-hbase4.apache.org/37995] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:11:39,664 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:11:39,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39949] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 18:11:39,665 DEBUG [Listener at jenkins-hbase4.apache.org/37995] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:11:39,666 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:11:39,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40677] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 18:11:39,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:11:39,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,672 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:11:39,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-18 18:11:39,672 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:11:39,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 18:11:39,675 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:11:39,675 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:11:39,676 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71 empty. 2023-07-18 18:11:39,676 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967 empty. 2023-07-18 18:11:39,676 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:11:39,676 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:11:39,676 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 18:11:39,689 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-18 18:11:39,690 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5fd21f75e2933036c6e646e43c5e5f71, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:11:39,690 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => ff4f579208704b1daa9d04fb308c4967, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:11:39,703 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:39,703 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 5fd21f75e2933036c6e646e43c5e5f71, disabling compactions & flushes 2023-07-18 18:11:39,703 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. 2023-07-18 18:11:39,703 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. 2023-07-18 18:11:39,703 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. after waiting 0 ms 2023-07-18 18:11:39,703 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. 2023-07-18 18:11:39,703 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. 2023-07-18 18:11:39,703 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 5fd21f75e2933036c6e646e43c5e5f71: 2023-07-18 18:11:39,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:39,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing ff4f579208704b1daa9d04fb308c4967, disabling compactions & flushes 2023-07-18 18:11:39,709 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. 2023-07-18 18:11:39,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. 2023-07-18 18:11:39,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. after waiting 0 ms 2023-07-18 18:11:39,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. 2023-07-18 18:11:39,709 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. 2023-07-18 18:11:39,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for ff4f579208704b1daa9d04fb308c4967: 2023-07-18 18:11:39,712 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:11:39,713 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703899713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703899713"}]},"ts":"1689703899713"} 2023-07-18 18:11:39,713 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703899713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703899713"}]},"ts":"1689703899713"} 2023-07-18 18:11:39,715 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:11:39,716 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:11:39,716 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703899716"}]},"ts":"1689703899716"} 2023-07-18 18:11:39,717 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-18 18:11:39,720 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:11:39,722 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:11:39,722 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:11:39,722 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:11:39,722 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:11:39,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5fd21f75e2933036c6e646e43c5e5f71, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff4f579208704b1daa9d04fb308c4967, ASSIGN}] 2023-07-18 18:11:39,725 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff4f579208704b1daa9d04fb308c4967, ASSIGN 2023-07-18 18:11:39,725 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5fd21f75e2933036c6e646e43c5e5f71, ASSIGN 2023-07-18 18:11:39,726 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff4f579208704b1daa9d04fb308c4967, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34171,1689703817322; forceNewPlan=false, retain=false 2023-07-18 18:11:39,726 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5fd21f75e2933036c6e646e43c5e5f71, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40677,1689703817386; forceNewPlan=false, retain=false 2023-07-18 18:11:39,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 18:11:39,876 INFO [jenkins-hbase4:40369] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:11:39,880 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5fd21f75e2933036c6e646e43c5e5f71, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:39,880 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ff4f579208704b1daa9d04fb308c4967, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:39,880 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703899880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703899880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703899880"}]},"ts":"1689703899880"} 2023-07-18 18:11:39,880 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703899880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703899880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703899880"}]},"ts":"1689703899880"} 2023-07-18 18:11:39,882 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 5fd21f75e2933036c6e646e43c5e5f71, server=jenkins-hbase4.apache.org,40677,1689703817386}] 2023-07-18 18:11:39,883 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure ff4f579208704b1daa9d04fb308c4967, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:11:39,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 18:11:40,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. 2023-07-18 18:11:40,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff4f579208704b1daa9d04fb308c4967, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967.', STARTKEY => '2', ENDKEY => ''} 2023-07-18 18:11:40,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. service=AccessControlService 2023-07-18 18:11:40,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:40,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:11:40,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:40,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:11:40,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:11:40,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. 2023-07-18 18:11:40,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5fd21f75e2933036c6e646e43c5e5f71, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71.', STARTKEY => '', ENDKEY => '2'} 2023-07-18 18:11:40,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. service=AccessControlService 2023-07-18 18:11:40,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:40,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:11:40,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:40,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:11:40,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:11:40,047 INFO [StoreOpener-ff4f579208704b1daa9d04fb308c4967-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:11:40,047 INFO [StoreOpener-5fd21f75e2933036c6e646e43c5e5f71-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:11:40,048 DEBUG [StoreOpener-ff4f579208704b1daa9d04fb308c4967-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/cf 2023-07-18 18:11:40,048 DEBUG [StoreOpener-ff4f579208704b1daa9d04fb308c4967-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/cf 2023-07-18 18:11:40,049 INFO [StoreOpener-ff4f579208704b1daa9d04fb308c4967-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff4f579208704b1daa9d04fb308c4967 columnFamilyName cf 2023-07-18 18:11:40,049 DEBUG [StoreOpener-5fd21f75e2933036c6e646e43c5e5f71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/cf 2023-07-18 18:11:40,049 DEBUG [StoreOpener-5fd21f75e2933036c6e646e43c5e5f71-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/cf 2023-07-18 18:11:40,050 INFO [StoreOpener-ff4f579208704b1daa9d04fb308c4967-1] regionserver.HStore(310): Store=ff4f579208704b1daa9d04fb308c4967/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:40,050 INFO [StoreOpener-5fd21f75e2933036c6e646e43c5e5f71-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fd21f75e2933036c6e646e43c5e5f71 columnFamilyName cf 2023-07-18 18:11:40,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:11:40,051 INFO [StoreOpener-5fd21f75e2933036c6e646e43c5e5f71-1] regionserver.HStore(310): Store=5fd21f75e2933036c6e646e43c5e5f71/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:40,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:11:40,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:11:40,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:11:40,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:11:40,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:11:40,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:40,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ff4f579208704b1daa9d04fb308c4967; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65048504, jitterRate=-0.030701756477355957}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:40,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ff4f579208704b1daa9d04fb308c4967: 2023-07-18 18:11:40,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:40,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967., pid=70, masterSystemTime=1689703900035 2023-07-18 18:11:40,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5fd21f75e2933036c6e646e43c5e5f71; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61949565, jitterRate=-0.07687954604625702}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:40,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5fd21f75e2933036c6e646e43c5e5f71: 2023-07-18 18:11:40,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71., pid=69, masterSystemTime=1689703900035 2023-07-18 18:11:40,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. 2023-07-18 18:11:40,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. 2023-07-18 18:11:40,062 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ff4f579208704b1daa9d04fb308c4967, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:40,062 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703900062"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703900062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703900062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703900062"}]},"ts":"1689703900062"} 2023-07-18 18:11:40,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. 2023-07-18 18:11:40,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. 2023-07-18 18:11:40,063 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5fd21f75e2933036c6e646e43c5e5f71, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:40,064 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703900063"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703900063"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703900063"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703900063"}]},"ts":"1689703900063"} 2023-07-18 18:11:40,070 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-18 18:11:40,070 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure ff4f579208704b1daa9d04fb308c4967, server=jenkins-hbase4.apache.org,34171,1689703817322 in 182 msec 2023-07-18 18:11:40,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-18 18:11:40,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 5fd21f75e2933036c6e646e43c5e5f71, server=jenkins-hbase4.apache.org,40677,1689703817386 in 184 msec 2023-07-18 18:11:40,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff4f579208704b1daa9d04fb308c4967, ASSIGN in 348 msec 2023-07-18 18:11:40,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-18 18:11:40,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5fd21f75e2933036c6e646e43c5e5f71, ASSIGN in 348 msec 2023-07-18 18:11:40,073 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:11:40,073 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703900073"}]},"ts":"1689703900073"} 2023-07-18 18:11:40,075 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-18 18:11:40,078 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:11:40,078 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-18 18:11:40,083 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 18:11:40,085 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:40,085 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:40,085 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:40,085 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:40,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:40,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:40,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:40,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:40,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:40,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:40,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:40,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:40,091 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 419 msec 2023-07-18 18:11:40,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 18:11:40,277 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-18 18:11:40,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 5fd21f75e2933036c6e646e43c5e5f71, ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:11:40,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5fd21f75e2933036c6e646e43c5e5f71, ff4f579208704b1daa9d04fb308c4967], force=true 2023-07-18 18:11:40,315 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5fd21f75e2933036c6e646e43c5e5f71, ff4f579208704b1daa9d04fb308c4967], force=true 2023-07-18 18:11:40,315 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5fd21f75e2933036c6e646e43c5e5f71, ff4f579208704b1daa9d04fb308c4967], force=true 2023-07-18 18:11:40,315 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5fd21f75e2933036c6e646e43c5e5f71, ff4f579208704b1daa9d04fb308c4967], force=true 2023-07-18 18:11:40,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 18:11:40,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5fd21f75e2933036c6e646e43c5e5f71, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff4f579208704b1daa9d04fb308c4967, UNASSIGN}] 2023-07-18 18:11:40,345 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5fd21f75e2933036c6e646e43c5e5f71, UNASSIGN 2023-07-18 18:11:40,345 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff4f579208704b1daa9d04fb308c4967, UNASSIGN 2023-07-18 18:11:40,346 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5fd21f75e2933036c6e646e43c5e5f71, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:40,346 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ff4f579208704b1daa9d04fb308c4967, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:40,346 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703900346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703900346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703900346"}]},"ts":"1689703900346"} 2023-07-18 18:11:40,346 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703900346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703900346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703900346"}]},"ts":"1689703900346"} 2023-07-18 18:11:40,348 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 5fd21f75e2933036c6e646e43c5e5f71, server=jenkins-hbase4.apache.org,40677,1689703817386}] 2023-07-18 18:11:40,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure ff4f579208704b1daa9d04fb308c4967, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:11:40,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 18:11:40,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:11:40,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5fd21f75e2933036c6e646e43c5e5f71, disabling compactions & flushes 2023-07-18 18:11:40,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. 2023-07-18 18:11:40,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. 2023-07-18 18:11:40,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. after waiting 0 ms 2023-07-18 18:11:40,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. 2023-07-18 18:11:40,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5fd21f75e2933036c6e646e43c5e5f71 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 18:11:40,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:11:40,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ff4f579208704b1daa9d04fb308c4967, disabling compactions & flushes 2023-07-18 18:11:40,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. 2023-07-18 18:11:40,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. 2023-07-18 18:11:40,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. after waiting 0 ms 2023-07-18 18:11:40,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. 2023-07-18 18:11:40,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ff4f579208704b1daa9d04fb308c4967 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 18:11:40,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/.tmp/cf/326130e6ec3b4589bfa268c51b3538e8 2023-07-18 18:11:40,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/.tmp/cf/326130e6ec3b4589bfa268c51b3538e8 as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/cf/326130e6ec3b4589bfa268c51b3538e8 2023-07-18 18:11:40,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/.tmp/cf/ebb13188e06444a9a4254ebb26a18ad1 2023-07-18 18:11:40,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/cf/326130e6ec3b4589bfa268c51b3538e8, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 18:11:40,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/.tmp/cf/ebb13188e06444a9a4254ebb26a18ad1 as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/cf/ebb13188e06444a9a4254ebb26a18ad1 2023-07-18 18:11:40,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ff4f579208704b1daa9d04fb308c4967 in 63ms, sequenceid=5, compaction requested=false 2023-07-18 18:11:40,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 18:11:40,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/cf/ebb13188e06444a9a4254ebb26a18ad1, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 18:11:40,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5fd21f75e2933036c6e646e43c5e5f71 in 73ms, sequenceid=5, compaction requested=false 2023-07-18 18:11:40,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 18:11:40,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 18:11:40,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:40,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:40,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967. 2023-07-18 18:11:40,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71. 2023-07-18 18:11:40,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5fd21f75e2933036c6e646e43c5e5f71: 2023-07-18 18:11:40,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ff4f579208704b1daa9d04fb308c4967: 2023-07-18 18:11:40,616 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5fd21f75e2933036c6e646e43c5e5f71, regionState=CLOSED 2023-07-18 18:11:40,616 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703900615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703900615"}]},"ts":"1689703900615"} 2023-07-18 18:11:40,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:11:40,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:11:40,617 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ff4f579208704b1daa9d04fb308c4967, regionState=CLOSED 2023-07-18 18:11:40,617 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703900617"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703900617"}]},"ts":"1689703900617"} 2023-07-18 18:11:40,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 18:11:40,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-18 18:11:40,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-18 18:11:40,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 5fd21f75e2933036c6e646e43c5e5f71, server=jenkins-hbase4.apache.org,40677,1689703817386 in 269 msec 2023-07-18 18:11:40,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure ff4f579208704b1daa9d04fb308c4967, server=jenkins-hbase4.apache.org,34171,1689703817322 in 270 msec 2023-07-18 18:11:40,625 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff4f579208704b1daa9d04fb308c4967, UNASSIGN in 280 msec 2023-07-18 18:11:40,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-18 18:11:40,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5fd21f75e2933036c6e646e43c5e5f71, UNASSIGN in 284 msec 2023-07-18 18:11:40,729 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-18 18:11:40,733 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899668.5fd21f75e2933036c6e646e43c5e5f71.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:40,733 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703899668.ff4f579208704b1daa9d04fb308c4967.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:40,733 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:40,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f57be8b183d559a3c8a85fb27add784, ASSIGN}] 2023-07-18 18:11:40,793 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f57be8b183d559a3c8a85fb27add784, ASSIGN 2023-07-18 18:11:40,795 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f57be8b183d559a3c8a85fb27add784, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,40677,1689703817386; forceNewPlan=false, retain=false 2023-07-18 18:11:40,879 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0004_000001 (auth:SIMPLE) 2023-07-18 18:11:40,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 18:11:40,946 INFO [jenkins-hbase4:40369] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:11:40,948 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=5f57be8b183d559a3c8a85fb27add784, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:40,948 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689703900948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703900948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703900948"}]},"ts":"1689703900948"} 2023-07-18 18:11:40,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 5f57be8b183d559a3c8a85fb27add784, server=jenkins-hbase4.apache.org,40677,1689703817386}] 2023-07-18 18:11:41,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. 2023-07-18 18:11:41,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f57be8b183d559a3c8a85fb27add784, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:11:41,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. service=AccessControlService 2023-07-18 18:11:41,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:41,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5f57be8b183d559a3c8a85fb27add784 2023-07-18 18:11:41,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:41,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f57be8b183d559a3c8a85fb27add784 2023-07-18 18:11:41,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f57be8b183d559a3c8a85fb27add784 2023-07-18 18:11:41,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/.regioninfo 2023-07-18 18:11:41,125 INFO [StoreOpener-5f57be8b183d559a3c8a85fb27add784-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5f57be8b183d559a3c8a85fb27add784 2023-07-18 18:11:41,127 DEBUG [StoreOpener-5f57be8b183d559a3c8a85fb27add784-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf 2023-07-18 18:11:41,127 DEBUG [StoreOpener-5f57be8b183d559a3c8a85fb27add784-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf 2023-07-18 18:11:41,127 INFO [StoreOpener-5f57be8b183d559a3c8a85fb27add784-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f57be8b183d559a3c8a85fb27add784 columnFamilyName cf 2023-07-18 18:11:41,161 DEBUG [StoreOpener-5f57be8b183d559a3c8a85fb27add784-1] regionserver.HStore(539): loaded hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf/326130e6ec3b4589bfa268c51b3538e8.ff4f579208704b1daa9d04fb308c4967->hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/cf/326130e6ec3b4589bfa268c51b3538e8-top 2023-07-18 18:11:41,168 DEBUG [StoreOpener-5f57be8b183d559a3c8a85fb27add784-1] regionserver.HStore(539): loaded hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf/ebb13188e06444a9a4254ebb26a18ad1.5fd21f75e2933036c6e646e43c5e5f71->hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/cf/ebb13188e06444a9a4254ebb26a18ad1-top 2023-07-18 18:11:41,168 INFO [StoreOpener-5f57be8b183d559a3c8a85fb27add784-1] regionserver.HStore(310): Store=5f57be8b183d559a3c8a85fb27add784/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:41,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784 2023-07-18 18:11:41,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784 2023-07-18 18:11:41,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f57be8b183d559a3c8a85fb27add784 2023-07-18 18:11:41,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f57be8b183d559a3c8a85fb27add784; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70324774, jitterRate=0.047920793294906616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:41,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f57be8b183d559a3c8a85fb27add784: 2023-07-18 18:11:41,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784., pid=77, masterSystemTime=1689703901104 2023-07-18 18:11:41,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784.,because compaction is disabled. 2023-07-18 18:11:41,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. 2023-07-18 18:11:41,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. 2023-07-18 18:11:41,178 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=5f57be8b183d559a3c8a85fb27add784, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,178 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689703901178"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703901178"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703901178"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703901178"}]},"ts":"1689703901178"} 2023-07-18 18:11:41,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-18 18:11:41,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 5f57be8b183d559a3c8a85fb27add784, server=jenkins-hbase4.apache.org,40677,1689703817386 in 228 msec 2023-07-18 18:11:41,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-18 18:11:41,185 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f57be8b183d559a3c8a85fb27add784, ASSIGN in 392 msec 2023-07-18 18:11:41,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5fd21f75e2933036c6e646e43c5e5f71, ff4f579208704b1daa9d04fb308c4967], force=true in 879 msec 2023-07-18 18:11:41,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 18:11:41,424 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-18 18:11:41,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 18:11:41,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703901425 (current time:1689703901425). 2023-07-18 18:11:41,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:11:41,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x063c6f80 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:41,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3905841d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:41,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:41,447 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:41,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x063c6f80 to 127.0.0.1:57608 2023-07-18 18:11:41,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:41,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x10318aef to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:41,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7594b706, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:41,461 DEBUG [hconnection-0x60a4f0c5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:41,462 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:41,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10318aef to 127.0.0.1:57608 2023-07-18 18:11:41,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:41,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 18:11:41,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:11:41,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 18:11:41,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 18:11:41,473 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 18:11:41,474 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689704501474 2023-07-18 18:11:41,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 18:11:41,474 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,478 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:11:41,479 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:11:41,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 18:11:41,481 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 18:11:41,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 11 msec 2023-07-18 18:11:41,485 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 18:11:41,486 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689704501486 2023-07-18 18:11:41,579 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:41,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 18:11:41,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:41,580 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:11:41,781 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:41,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 18:11:41,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:41,782 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:11:41,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,909 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 18:11:41,909 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:41,909 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-18 18:11:41,909 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-18 18:11:41,910 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,910 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,912 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:41,912 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:41,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:41,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,918 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:41,918 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:41,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:41,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 18:11:41,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 18:11:41,918 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,919 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:11:41,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,919 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 18:11:41,919 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 18:11:41,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,919 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 18:11:41,919 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:41,921 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 18:11:41,921 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 18:11:41,921 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 18:11:41,921 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:41,921 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 18:11:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 18:11:41,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,922 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 18:11:41,923 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 18:11:41,923 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 18:11:41,923 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 18:11:41,923 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,923 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 18:11:41,923 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:41,925 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 18:11:41,925 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 18:11:41,925 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 18:11:41,925 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,926 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,926 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,926 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:41,927 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,927 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,927 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,927 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:41,927 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,927 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:41,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:41,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:41,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:41,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-18 18:11:41,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c197717[Count = 0] remaining members to acquire global barrier 2023-07-18 18:11:41,930 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-18 18:11:41,930 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,932 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,932 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,932 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,933 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 18:11:41,933 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 18:11:41,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,933 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:11:41,933 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 18:11:41,933 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,933 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:11:41,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,933 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 18:11:41,933 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 18:11:41,933 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:11:41,933 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:41,933 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:41,933 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. 2023-07-18 18:11:41,934 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. started... 2023-07-18 18:11:41,935 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f57be8b183d559a3c8a85fb27add784: 2023-07-18 18:11:41,935 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 18:11:41,936 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:41,936 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 18:11:41,936 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,937 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:41,937 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 18:11:41,937 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:41,937 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 18:11:41,941 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf/326130e6ec3b4589bfa268c51b3538e8.ff4f579208704b1daa9d04fb308c4967->hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/cf/326130e6ec3b4589bfa268c51b3538e8-top, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf/ebb13188e06444a9a4254ebb26a18ad1.5fd21f75e2933036c6e646e43c5e5f71->hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/cf/ebb13188e06444a9a4254ebb26a18ad1-top] hfiles 2023-07-18 18:11:41,941 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf/326130e6ec3b4589bfa268c51b3538e8.ff4f579208704b1daa9d04fb308c4967 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,942 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf/ebb13188e06444a9a4254ebb26a18ad1.5fd21f75e2933036c6e646e43c5e5f71 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,963 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. completed. 2023-07-18 18:11:41,963 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. 2023-07-18 18:11:41,964 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:41,964 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:41,964 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,964 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 18:11:41,964 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:11:41,971 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,971 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 18:11:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:41,971 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:41,972 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 18:11:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:41,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:41,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:41,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,40677,1689703817386': 2023-07-18 18:11:41,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-18 18:11:41,975 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-18 18:11:41,976 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:11:41,976 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:11:41,976 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,976 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:11:41,977 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,977 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,977 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,978 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:41,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,978 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:41,978 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,978 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:41,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:41,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:41,979 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:41,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:41,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,980 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:41,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:41,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:41,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,980 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:41,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:41,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:41,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,982 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:41,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:41,983 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:41,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,983 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:41,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:41,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,987 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:41,987 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:41,987 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:41,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:41,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:41,987 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:41,987 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:41,987 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:41,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:41,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:41,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:41,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:41,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:41,988 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,988 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,988 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:41,988 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:41,988 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,988 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:41,988 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,988 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:41,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:41,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:41,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:41,988 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:11:41,988 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:11:41,988 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,988 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:41,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:41,990 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:41,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:42,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:42,082 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:42,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 18:11:42,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:42,084 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 18:11:42,087 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-18 18:11:42,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:42,088 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:42,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689703901474Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689703901990 (+516 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689703901990Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689703901998 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689703902011 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689703902087 (+76 ms) 2023-07-18 18:11:42,091 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 18:11:42,092 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 613 msec 2023-07-18 18:11:42,152 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:11:42,585 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:42,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 18:11:42,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:11:42,586 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703902586 2023-07-18 18:11:42,587 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35301, tgtDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703902586, rawTgtDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703902586, srcFsUri=hdfs://localhost:35301, srcDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:11:42,618 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:11:42,618 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1998622600_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703902586, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703902586/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:42,619 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9, snapshotDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-18 18:11:42,639 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703902586/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:42,702 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,703 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,703 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,704 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,704 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,705 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,705 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,801 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/hadoop-1747701035674545691.jar 2023-07-18 18:11:42,802 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,803 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,803 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,804 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,804 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,805 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:42,805 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:11:42,806 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:11:42,806 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:11:42,806 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:11:42,807 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:11:42,807 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:11:42,808 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:11:42,808 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:11:42,809 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:11:42,810 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:11:42,810 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:42,810 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:42,811 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:42,811 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:42,811 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:42,812 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:42,812 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:44,630 WARN [DataStreamer for file /user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689703825988_0005/libjars/hbase-unsafe-4.1.4.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-18 18:11:45,323 WARN [Listener at jenkins-hbase4.apache.org/37995] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:11:45,340 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-18 18:11:45,348 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-18 18:11:45,540 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:11:45,540 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:11:45,628 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0005_000001 (auth:SIMPLE) 2023-07-18 18:11:51,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0005_000001 (auth:SIMPLE) 2023-07-18 18:11:54,320 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0005_000001 (auth:SIMPLE) 2023-07-18 18:11:57,799 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0005_000001 (auth:SIMPLE) 2023-07-18 18:11:59,777 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:11:59,782 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:11:59,823 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:59,823 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:11:59,824 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:11:59,824 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-859359611_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:59,824 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 18:11:59,824 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 18:11:59,824 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-859359611_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703902586/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703902586/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:59,825 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703902586/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 18:11:59,825 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703902586/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 18:11:59,832 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:59,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:59,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:59,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 18:11:59,838 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703919838"}]},"ts":"1689703919838"} 2023-07-18 18:11:59,839 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-18 18:11:59,841 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-18 18:11:59,842 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f57be8b183d559a3c8a85fb27add784, UNASSIGN}] 2023-07-18 18:11:59,844 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f57be8b183d559a3c8a85fb27add784, UNASSIGN 2023-07-18 18:11:59,844 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=5f57be8b183d559a3c8a85fb27add784, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:11:59,845 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689703919844"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703919844"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703919844"}]},"ts":"1689703919844"} 2023-07-18 18:11:59,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 5f57be8b183d559a3c8a85fb27add784, server=jenkins-hbase4.apache.org,40677,1689703817386}] 2023-07-18 18:11:59,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 18:11:59,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5f57be8b183d559a3c8a85fb27add784 2023-07-18 18:11:59,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f57be8b183d559a3c8a85fb27add784, disabling compactions & flushes 2023-07-18 18:11:59,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. 2023-07-18 18:11:59,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. 2023-07-18 18:11:59,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. after waiting 0 ms 2023-07-18 18:11:59,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. 2023-07-18 18:12:00,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-18 18:12:00,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:00,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784. 2023-07-18 18:12:00,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f57be8b183d559a3c8a85fb27add784: 2023-07-18 18:12:00,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5f57be8b183d559a3c8a85fb27add784 2023-07-18 18:12:00,029 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=5f57be8b183d559a3c8a85fb27add784, regionState=CLOSED 2023-07-18 18:12:00,029 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689703920029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703920029"}]},"ts":"1689703920029"} 2023-07-18 18:12:00,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-18 18:12:00,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 5f57be8b183d559a3c8a85fb27add784, server=jenkins-hbase4.apache.org,40677,1689703817386 in 185 msec 2023-07-18 18:12:00,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-18 18:12:00,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f57be8b183d559a3c8a85fb27add784, UNASSIGN in 191 msec 2023-07-18 18:12:00,035 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703920035"}]},"ts":"1689703920035"} 2023-07-18 18:12:00,044 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-18 18:12:00,046 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-18 18:12:00,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 213 msec 2023-07-18 18:12:00,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 18:12:00,141 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-18 18:12:00,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,147 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,149 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,150 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,154 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784 2023-07-18 18:12:00,154 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:12:00,155 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:12:00,156 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,156 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,156 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,156 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 18:12:00,157 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/recovered.edits] 2023-07-18 18:12:00,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 18:12:00,157 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 18:12:00,157 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/recovered.edits] 2023-07-18 18:12:00,158 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,158 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:00,158 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:00,158 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,158 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:00,158 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/recovered.edits] 2023-07-18 18:12:00,158 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,158 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:00,159 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:00,159 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:00,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 18:12:00,159 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:00,160 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-18 18:12:00,160 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 18:12:00,161 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:00,164 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/cf/326130e6ec3b4589bfa268c51b3538e8 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/cf/326130e6ec3b4589bfa268c51b3538e8 2023-07-18 18:12:00,165 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/cf/ebb13188e06444a9a4254ebb26a18ad1 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/cf/ebb13188e06444a9a4254ebb26a18ad1 2023-07-18 18:12:00,166 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf/326130e6ec3b4589bfa268c51b3538e8.ff4f579208704b1daa9d04fb308c4967 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf/326130e6ec3b4589bfa268c51b3538e8.ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:12:00,168 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/recovered.edits/8.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967/recovered.edits/8.seqid 2023-07-18 18:12:00,168 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf/ebb13188e06444a9a4254ebb26a18ad1.5fd21f75e2933036c6e646e43c5e5f71 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/cf/ebb13188e06444a9a4254ebb26a18ad1.5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:12:00,169 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff4f579208704b1daa9d04fb308c4967 2023-07-18 18:12:00,170 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/recovered.edits/8.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71/recovered.edits/8.seqid 2023-07-18 18:12:00,171 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5fd21f75e2933036c6e646e43c5e5f71 2023-07-18 18:12:00,173 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/recovered.edits/12.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784/recovered.edits/12.seqid 2023-07-18 18:12:00,173 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f57be8b183d559a3c8a85fb27add784 2023-07-18 18:12:00,174 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 18:12:00,181 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,191 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-18 18:12:00,197 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-18 18:12:00,199 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,199 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-18 18:12:00,200 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703920200"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:00,202 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-18 18:12:00,202 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5f57be8b183d559a3c8a85fb27add784, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689703899669.5f57be8b183d559a3c8a85fb27add784.', STARTKEY => '', ENDKEY => ''}] 2023-07-18 18:12:00,202 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-18 18:12:00,202 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703920202"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:00,208 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-18 18:12:00,215 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 73 msec 2023-07-18 18:12:00,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 18:12:00,261 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-18 18:12:00,261 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 18:12:00,267 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703920267"}]},"ts":"1689703920267"} 2023-07-18 18:12:00,269 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-18 18:12:00,270 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-18 18:12:00,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e42e9e01dd314afad9f2ffb4149d28d6, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d6cb3eb339c61a767221a2bf2842129e, UNASSIGN}] 2023-07-18 18:12:00,274 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e42e9e01dd314afad9f2ffb4149d28d6, UNASSIGN 2023-07-18 18:12:00,274 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d6cb3eb339c61a767221a2bf2842129e, UNASSIGN 2023-07-18 18:12:00,274 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e42e9e01dd314afad9f2ffb4149d28d6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:00,274 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=d6cb3eb339c61a767221a2bf2842129e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:00,274 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703920274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703920274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703920274"}]},"ts":"1689703920274"} 2023-07-18 18:12:00,275 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703920274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703920274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703920274"}]},"ts":"1689703920274"} 2023-07-18 18:12:00,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure e42e9e01dd314afad9f2ffb4149d28d6, server=jenkins-hbase4.apache.org,40677,1689703817386}] 2023-07-18 18:12:00,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure d6cb3eb339c61a767221a2bf2842129e, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:12:00,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 18:12:00,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:12:00,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e42e9e01dd314afad9f2ffb4149d28d6, disabling compactions & flushes 2023-07-18 18:12:00,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:12:00,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:12:00,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. after waiting 0 ms 2023-07-18 18:12:00,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:12:00,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:12:00,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d6cb3eb339c61a767221a2bf2842129e, disabling compactions & flushes 2023-07-18 18:12:00,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:12:00,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:12:00,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. after waiting 0 ms 2023-07-18 18:12:00,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:12:00,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:12:00,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:00,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6. 2023-07-18 18:12:00,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e42e9e01dd314afad9f2ffb4149d28d6: 2023-07-18 18:12:00,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:12:00,451 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e42e9e01dd314afad9f2ffb4149d28d6, regionState=CLOSED 2023-07-18 18:12:00,451 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703920451"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703920451"}]},"ts":"1689703920451"} 2023-07-18 18:12:00,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:12:00,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:00,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e. 2023-07-18 18:12:00,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d6cb3eb339c61a767221a2bf2842129e: 2023-07-18 18:12:00,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:12:00,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-18 18:12:00,455 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=d6cb3eb339c61a767221a2bf2842129e, regionState=CLOSED 2023-07-18 18:12:00,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure e42e9e01dd314afad9f2ffb4149d28d6, server=jenkins-hbase4.apache.org,40677,1689703817386 in 177 msec 2023-07-18 18:12:00,455 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703920455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703920455"}]},"ts":"1689703920455"} 2023-07-18 18:12:00,456 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e42e9e01dd314afad9f2ffb4149d28d6, UNASSIGN in 184 msec 2023-07-18 18:12:00,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-18 18:12:00,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure d6cb3eb339c61a767221a2bf2842129e, server=jenkins-hbase4.apache.org,34171,1689703817322 in 180 msec 2023-07-18 18:12:00,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-18 18:12:00,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d6cb3eb339c61a767221a2bf2842129e, UNASSIGN in 187 msec 2023-07-18 18:12:00,460 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703920460"}]},"ts":"1689703920460"} 2023-07-18 18:12:00,461 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-18 18:12:00,464 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-18 18:12:00,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 202 msec 2023-07-18 18:12:00,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 18:12:00,570 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-18 18:12:00,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,579 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,579 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,582 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,585 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:12:00,585 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:12:00,585 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,585 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,585 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 18:12:00,587 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 18:12:00,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 18:12:00,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 18:12:00,591 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,591 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,591 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:00,591 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:00,591 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,591 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:00,591 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,591 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:00,591 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/recovered.edits] 2023-07-18 18:12:00,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 18:12:00,592 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/recovered.edits] 2023-07-18 18:12:00,597 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/cf/1bda24282ffa4c589d1d4d242baae4a9 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/cf/1bda24282ffa4c589d1d4d242baae4a9 2023-07-18 18:12:00,597 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/cf/baffb8d3590841b39a0c482a3bc31089 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/cf/baffb8d3590841b39a0c482a3bc31089 2023-07-18 18:12:00,601 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/recovered.edits/9.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e/recovered.edits/9.seqid 2023-07-18 18:12:00,602 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/recovered.edits/9.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6/recovered.edits/9.seqid 2023-07-18 18:12:00,602 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d6cb3eb339c61a767221a2bf2842129e 2023-07-18 18:12:00,602 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e42e9e01dd314afad9f2ffb4149d28d6 2023-07-18 18:12:00,602 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 18:12:00,603 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-18 18:12:00,604 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-18 18:12:00,608 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230718ac3f9eefc3b3408b9c439451d2162f75 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230718ac3f9eefc3b3408b9c439451d2162f75 2023-07-18 18:12:00,610 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718974974c2ed64422982086925ba829613 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718974974c2ed64422982086925ba829613 2023-07-18 18:12:00,611 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-18 18:12:00,613 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,616 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-18 18:12:00,619 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-18 18:12:00,621 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,621 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-18 18:12:00,621 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703920621"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:00,621 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703920621"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:00,623 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 18:12:00,623 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e42e9e01dd314afad9f2ffb4149d28d6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689703897127.e42e9e01dd314afad9f2ffb4149d28d6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d6cb3eb339c61a767221a2bf2842129e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689703897127.d6cb3eb339c61a767221a2bf2842129e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 18:12:00,623 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-18 18:12:00,623 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703920623"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:00,624 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-18 18:12:00,626 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 55 msec 2023-07-18 18:12:00,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 18:12:00,694 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-18 18:12:00,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 18:12:00,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 18:12:00,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:12:00,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-18 18:12:00,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:12:00,747 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 744) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:44730 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:46223 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1395874757_1 at /127.0.0.1:50058 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:40716 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:47890 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4104 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1395874757_1 at /127.0.0.1:47868 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:50094 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=549 (was 476) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 187), AvailableMemoryMB=2297 (was 2558) 2023-07-18 18:12:00,748 WARN [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-18 18:12:00,780 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=549, ProcessCount=184, AvailableMemoryMB=2292 2023-07-18 18:12:00,781 WARN [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-18 18:12:00,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 18:12:00,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:00,787 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:12:00,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-18 18:12:00,788 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:12:00,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 18:12:00,791 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:00,791 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:00,792 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a empty. 2023-07-18 18:12:00,792 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8 empty. 2023-07-18 18:12:00,795 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:00,795 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:00,795 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 18:12:00,814 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 18:12:00,815 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 88bf99ad509e5d6b47d59ae9aed1384a, NAME => 'testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:12:00,816 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => d5671252cebad51664e6d1ccc5fa60f8, NAME => 'testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:12:00,844 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:12:00,844 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 88bf99ad509e5d6b47d59ae9aed1384a, disabling compactions & flushes 2023-07-18 18:12:00,844 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:00,844 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:00,844 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. after waiting 0 ms 2023-07-18 18:12:00,844 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:00,844 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:00,844 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 88bf99ad509e5d6b47d59ae9aed1384a: 2023-07-18 18:12:00,849 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:12:00,849 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing d5671252cebad51664e6d1ccc5fa60f8, disabling compactions & flushes 2023-07-18 18:12:00,849 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:00,849 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:00,849 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. after waiting 0 ms 2023-07-18 18:12:00,849 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:00,849 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:00,849 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for d5671252cebad51664e6d1ccc5fa60f8: 2023-07-18 18:12:00,857 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:12:00,858 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703920858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703920858"}]},"ts":"1689703920858"} 2023-07-18 18:12:00,858 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703920858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703920858"}]},"ts":"1689703920858"} 2023-07-18 18:12:00,861 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:12:00,862 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:12:00,862 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703920862"}]},"ts":"1689703920862"} 2023-07-18 18:12:00,863 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 18:12:00,867 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:12:00,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:12:00,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:12:00,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:12:00,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:12:00,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=88bf99ad509e5d6b47d59ae9aed1384a, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5671252cebad51664e6d1ccc5fa60f8, ASSIGN}] 2023-07-18 18:12:00,875 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5671252cebad51664e6d1ccc5fa60f8, ASSIGN 2023-07-18 18:12:00,875 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=88bf99ad509e5d6b47d59ae9aed1384a, ASSIGN 2023-07-18 18:12:00,876 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5671252cebad51664e6d1ccc5fa60f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34171,1689703817322; forceNewPlan=false, retain=false 2023-07-18 18:12:00,878 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=88bf99ad509e5d6b47d59ae9aed1384a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40677,1689703817386; forceNewPlan=false, retain=false 2023-07-18 18:12:00,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 18:12:01,026 INFO [jenkins-hbase4:40369] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:12:01,030 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=88bf99ad509e5d6b47d59ae9aed1384a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,030 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d5671252cebad51664e6d1ccc5fa60f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,030 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703921030"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703921030"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703921030"}]},"ts":"1689703921030"} 2023-07-18 18:12:01,030 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703921030"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703921030"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703921030"}]},"ts":"1689703921030"} 2023-07-18 18:12:01,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 88bf99ad509e5d6b47d59ae9aed1384a, server=jenkins-hbase4.apache.org,40677,1689703817386}] 2023-07-18 18:12:01,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure d5671252cebad51664e6d1ccc5fa60f8, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:12:01,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 18:12:01,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:01,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 88bf99ad509e5d6b47d59ae9aed1384a, NAME => 'testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 18:12:01,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. service=AccessControlService 2023-07-18 18:12:01,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:12:01,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:01,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:12:01,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:01,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:01,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:01,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5671252cebad51664e6d1ccc5fa60f8, NAME => 'testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 18:12:01,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. service=AccessControlService 2023-07-18 18:12:01,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:12:01,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:01,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:12:01,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:01,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:01,195 INFO [StoreOpener-88bf99ad509e5d6b47d59ae9aed1384a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:01,197 DEBUG [StoreOpener-88bf99ad509e5d6b47d59ae9aed1384a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/cf 2023-07-18 18:12:01,197 DEBUG [StoreOpener-88bf99ad509e5d6b47d59ae9aed1384a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/cf 2023-07-18 18:12:01,197 INFO [StoreOpener-88bf99ad509e5d6b47d59ae9aed1384a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88bf99ad509e5d6b47d59ae9aed1384a columnFamilyName cf 2023-07-18 18:12:01,199 INFO [StoreOpener-88bf99ad509e5d6b47d59ae9aed1384a-1] regionserver.HStore(310): Store=88bf99ad509e5d6b47d59ae9aed1384a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:12:01,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:01,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:01,204 INFO [StoreOpener-d5671252cebad51664e6d1ccc5fa60f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:01,206 DEBUG [StoreOpener-d5671252cebad51664e6d1ccc5fa60f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/cf 2023-07-18 18:12:01,206 DEBUG [StoreOpener-d5671252cebad51664e6d1ccc5fa60f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/cf 2023-07-18 18:12:01,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:01,207 INFO [StoreOpener-d5671252cebad51664e6d1ccc5fa60f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5671252cebad51664e6d1ccc5fa60f8 columnFamilyName cf 2023-07-18 18:12:01,211 INFO [StoreOpener-d5671252cebad51664e6d1ccc5fa60f8-1] regionserver.HStore(310): Store=d5671252cebad51664e6d1ccc5fa60f8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:12:01,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:12:01,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:01,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:01,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:01,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 88bf99ad509e5d6b47d59ae9aed1384a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64530394, jitterRate=-0.038422197103500366}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:12:01,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 88bf99ad509e5d6b47d59ae9aed1384a: 2023-07-18 18:12:01,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a., pid=93, masterSystemTime=1689703921184 2023-07-18 18:12:01,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:01,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:01,224 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=88bf99ad509e5d6b47d59ae9aed1384a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,224 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703921224"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703921224"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703921224"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703921224"}]},"ts":"1689703921224"} 2023-07-18 18:12:01,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-18 18:12:01,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 88bf99ad509e5d6b47d59ae9aed1384a, server=jenkins-hbase4.apache.org,40677,1689703817386 in 194 msec 2023-07-18 18:12:01,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=88bf99ad509e5d6b47d59ae9aed1384a, ASSIGN in 359 msec 2023-07-18 18:12:01,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:12:01,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d5671252cebad51664e6d1ccc5fa60f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68144414, jitterRate=0.01543089747428894}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:12:01,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d5671252cebad51664e6d1ccc5fa60f8: 2023-07-18 18:12:01,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8., pid=94, masterSystemTime=1689703921187 2023-07-18 18:12:01,234 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d5671252cebad51664e6d1ccc5fa60f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,235 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703921234"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703921234"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703921234"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703921234"}]},"ts":"1689703921234"} 2023-07-18 18:12:01,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:01,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:01,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-18 18:12:01,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure d5671252cebad51664e6d1ccc5fa60f8, server=jenkins-hbase4.apache.org,34171,1689703817322 in 201 msec 2023-07-18 18:12:01,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-18 18:12:01,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5671252cebad51664e6d1ccc5fa60f8, ASSIGN in 369 msec 2023-07-18 18:12:01,244 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:12:01,245 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703921244"}]},"ts":"1689703921244"} 2023-07-18 18:12:01,246 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 18:12:01,249 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:12:01,249 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-18 18:12:01,252 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 18:12:01,254 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:01,254 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:01,254 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:01,254 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:01,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:01,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:01,262 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:01,263 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:01,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 480 msec 2023-07-18 18:12:01,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 18:12:01,393 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-18 18:12:01,395 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-18 18:12:01,396 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:01,398 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:12:01,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:12:01,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703921413 (current time:1689703921413). 2023-07-18 18:12:01,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:12:01,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x7560d2c8 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:12:01,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17ed98b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:12:01,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:12:01,435 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:12:01,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7560d2c8 to 127.0.0.1:57608 2023-07-18 18:12:01,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:01,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x1c737769 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:12:01,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ff600bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:12:01,446 DEBUG [hconnection-0x142515d4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:12:01,450 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:12:01,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c737769 to 127.0.0.1:57608 2023-07-18 18:12:01,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:01,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 18:12:01,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:12:01,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:12:01,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:12:01,462 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:12:01,463 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689704521463 2023-07-18 18:12:01,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:12:01,463 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 18:12:01,465 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:12:01,465 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:12:01,466 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:12:01,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 18:12:01,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-18 18:12:01,472 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 18:12:01,472 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689704521472 2023-07-18 18:12:01,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,487 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-18 18:12:01,487 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:01,488 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 18:12:01,488 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 18:12:01,489 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,489 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,499 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:01,499 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:01,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:01,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:01,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:01,499 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:01,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:01,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:01,499 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:01,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,501 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,501 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,501 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,501 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:12:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 18:12:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 18:12:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 18:12:01,502 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 18:12:01,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,503 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 18:12:01,503 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 18:12:01,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 18:12:01,505 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 18:12:01,504 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 18:12:01,506 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,506 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 18:12:01,506 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 18:12:01,506 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:01,506 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:01,508 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 18:12:01,506 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 18:12:01,512 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 18:12:01,512 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 18:12:01,512 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 18:12:01,512 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 18:12:01,512 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 18:12:01,515 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,516 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,516 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,516 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,516 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,516 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,516 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:01,517 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,517 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:01,517 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,517 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:01,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 18:12:01,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ac75bde[Count = 1] remaining members to acquire global barrier 2023-07-18 18:12:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:01,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 18:12:01,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ac75bde[Count = 0] remaining members to acquire global barrier 2023-07-18 18:12:01,522 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 18:12:01,522 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,526 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,526 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:12:01,526 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,526 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,526 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 18:12:01,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,526 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:12:01,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,526 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,526 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:12:01,526 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:12:01,527 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,527 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:12:01,529 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 18:12:01,529 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:01,529 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 18:12:01,533 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:12:01,533 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:12:01,535 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:12:01,535 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:01,535 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:01,535 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. started... 2023-07-18 18:12:01,535 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:12:01,535 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. started... 2023-07-18 18:12:01,537 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d5671252cebad51664e6d1ccc5fa60f8: 2023-07-18 18:12:01,537 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 88bf99ad509e5d6b47d59ae9aed1384a: 2023-07-18 18:12:01,537 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,537 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,537 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:12:01,537 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:12:01,537 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:12:01,537 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:12:01,564 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. completed. 2023-07-18 18:12:01,564 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:01,564 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:12:01,564 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:12:01,564 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,564 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 18:12:01,564 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:12:01,565 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:01,566 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 18:12:01,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:12:01,566 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:01,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:12:01,566 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,568 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:12:01,566 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 18:12:01,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:01,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:01,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:01,571 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. completed. 2023-07-18 18:12:01,571 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:01,571 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:12:01,572 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:12:01,572 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,572 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 18:12:01,572 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:12:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,573 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:01,573 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 18:12:01,574 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:01,574 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 18:12:01,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:01,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34171,1689703817322': 2023-07-18 18:12:01,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 18:12:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:01,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:01,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:01,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:01,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40677,1689703817386': 2023-07-18 18:12:01,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 18:12:01,583 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 18:12:01,583 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:12:01,583 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:12:01,583 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,583 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:12:01,585 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,585 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:01,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,585 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,585 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:01,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:01,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:01,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:01,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:01,586 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,586 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,586 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:01,591 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:01,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,594 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:01,595 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:01,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:01,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,597 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:01,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:01,597 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,597 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,601 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,601 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,601 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:01,601 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:01,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:01,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:01,601 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:01,601 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,601 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:01,601 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-18 18:12:01,601 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:01,602 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:01,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 18:12:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:01,601 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:01,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:01,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:01,602 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:01,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 18:12:01,604 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,605 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:01,605 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,605 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:01,605 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:01,605 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,605 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:01,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:01,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:01,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:01,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:01,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:01,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,702 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 18:12:01,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,702 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689703921463Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689703921614 (+151 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689703921614Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689703921614Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689703921619 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689703921639 (+20 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689703921702 (+63 ms) 2023-07-18 18:12:01,708 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 18:12:01,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 243 msec 2023-07-18 18:12:01,769 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:01,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:12:01,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:12:01,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40677] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:12:01,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34171] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:12:01,790 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-18 18:12:01,790 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:01,791 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:12:01,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:12:01,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703921809 (current time:1689703921809). 2023-07-18 18:12:01,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:12:01,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x2ca60ef7 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:12:01,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10112502, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:12:01,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:12:01,835 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:12:01,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ca60ef7 to 127.0.0.1:57608 2023-07-18 18:12:01,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:01,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x68e82634 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:12:01,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74a55c68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:12:01,942 DEBUG [hconnection-0x6d855ecb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:12:01,946 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:12:01,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68e82634 to 127.0.0.1:57608 2023-07-18 18:12:01,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:01,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 18:12:01,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:12:01,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:12:01,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:12:01,961 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:12:01,962 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689704521962 2023-07-18 18:12:01,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:12:01,962 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 18:12:01,962 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:12:01,963 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:12:01,965 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:12:01,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 18:12:01,966 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-18 18:12:01,969 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 18:12:01,970 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689704521970 2023-07-18 18:12:01,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:01,985 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-18 18:12:01,985 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:01,987 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 18:12:01,987 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 18:12:02,056 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,056 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,058 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:02,058 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,058 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,058 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,059 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,059 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:12:02,060 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-18 18:12:02,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:02,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:02,058 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:02,058 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:02,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:02,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,064 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 18:12:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 18:12:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 18:12:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 18:12:02,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 18:12:02,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,065 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 18:12:02,065 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:02,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:12:02,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:12:02,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 18:12:02,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,068 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 18:12:02,068 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 18:12:02,068 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 18:12:02,069 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 18:12:02,069 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:02,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 18:12:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 18:12:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 18:12:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:02,070 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 18:12:02,078 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:12:02,074 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 18:12:02,079 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 18:12:02,079 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 18:12:02,079 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,079 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,079 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:02,080 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,080 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,080 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:02,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:02,080 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,081 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,081 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:02,081 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,081 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:02,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:02,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:02,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 18:12:02,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b2cda93[Count = 1] remaining members to acquire global barrier 2023-07-18 18:12:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:02,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:02,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:02,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:02,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 18:12:02,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b2cda93[Count = 0] remaining members to acquire global barrier 2023-07-18 18:12:02,086 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 18:12:02,086 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,101 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,101 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,101 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,101 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:12:02,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,101 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,101 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:12:02,101 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:12:02,102 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 18:12:02,102 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:12:02,102 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:12:02,102 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:02,102 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:12:02,102 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. started... 2023-07-18 18:12:02,102 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,102 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:12:02,102 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:12:02,102 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:12:02,102 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:02,102 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 88bf99ad509e5d6b47d59ae9aed1384a 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-18 18:12:02,102 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. started... 2023-07-18 18:12:02,103 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d5671252cebad51664e6d1ccc5fa60f8 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-18 18:12:02,103 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 18:12:02,103 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:02,103 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 18:12:02,152 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307189aff5540d6d54843bd29b0a8f9659ad1 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307189aff5540d6d54843bd29b0a8f9659ad1 2023-07-18 18:12:02,152 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307186419a28f208543689b395be6bb722640 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307186419a28f208543689b395be6bb722640 2023-07-18 18:12:02,279 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:02,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:12:02,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:12:02,280 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:12:02,575 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/.tmp/cf/b9a7123ab98f4b1281b648239f43b4fc 2023-07-18 18:12:02,577 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/.tmp/cf/fc110312fc7d44fcaa4f95f78d14a44e 2023-07-18 18:12:02,580 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:02,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:12:02,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:12:02,582 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 18:12:02,584 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/.tmp/cf/b9a7123ab98f4b1281b648239f43b4fc as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/cf/b9a7123ab98f4b1281b648239f43b4fc 2023-07-18 18:12:02,586 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/.tmp/cf/fc110312fc7d44fcaa4f95f78d14a44e as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/cf/fc110312fc7d44fcaa4f95f78d14a44e 2023-07-18 18:12:02,592 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/cf/b9a7123ab98f4b1281b648239f43b4fc, entries=2, sequenceid=6, filesize=5.2 K 2023-07-18 18:12:02,595 INFO [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 88bf99ad509e5d6b47d59ae9aed1384a in 493ms, sequenceid=6, compaction requested=false 2023-07-18 18:12:02,597 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 88bf99ad509e5d6b47d59ae9aed1384a: 2023-07-18 18:12:02,597 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,597 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:12:02,597 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/cf/b9a7123ab98f4b1281b648239f43b4fc] hfiles 2023-07-18 18:12:02,597 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/cf/b9a7123ab98f4b1281b648239f43b4fc for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,600 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/cf/fc110312fc7d44fcaa4f95f78d14a44e, entries=48, sequenceid=6, filesize=13.2 K 2023-07-18 18:12:02,601 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for d5671252cebad51664e6d1ccc5fa60f8 in 499ms, sequenceid=6, compaction requested=false 2023-07-18 18:12:02,601 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d5671252cebad51664e6d1ccc5fa60f8: 2023-07-18 18:12:02,601 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,624 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:12:02,624 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/cf/fc110312fc7d44fcaa4f95f78d14a44e] hfiles 2023-07-18 18:12:02,624 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/cf/fc110312fc7d44fcaa4f95f78d14a44e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,640 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. completed. 2023-07-18 18:12:02,640 DEBUG [rs(jenkins-hbase4.apache.org,40677,1689703817386)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:02,640 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:12:02,640 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:12:02,640 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,640 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 18:12:02,640 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:12:02,643 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,643 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 18:12:02,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:02,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:02,643 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:02,644 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 18:12:02,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:02,646 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. completed. 2023-07-18 18:12:02,646 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:02,646 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:12:02,646 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:12:02,646 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,646 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 18:12:02,646 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:12:02,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:02,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:02,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:02,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:02,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,656 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 18:12:02,656 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,656 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:02,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40677,1689703817386': 2023-07-18 18:12:02,656 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 18:12:02,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 18:12:02,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:02,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:02,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:02,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:02,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:02,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34171,1689703817322': 2023-07-18 18:12:02,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 18:12:02,663 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 18:12:02,663 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:12:02,663 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:12:02,663 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,663 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:12:02,665 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,665 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,665 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:02,665 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:02,666 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:02,666 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:02,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,665 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:02,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:02,667 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,666 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:02,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,667 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:02,670 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,670 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:02,671 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,673 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,673 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:02,673 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:02,673 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:02,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:02,673 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:02,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:02,673 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:02,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:02,673 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:02,674 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,673 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:02,674 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-18 18:12:02,673 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:02,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,673 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:02,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 18:12:02,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:02,674 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:02,676 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,676 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:02,677 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,677 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:02,677 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:02,677 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,677 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307189aff5540d6d54843bd29b0a8f9659ad1, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307186419a28f208543689b395be6bb722640] mob files 2023-07-18 18:12:02,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307189aff5540d6d54843bd29b0a8f9659ad1 2023-07-18 18:12:02,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307186419a28f208543689b395be6bb722640 2023-07-18 18:12:02,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,940 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 18:12:02,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,941 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:02,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689703921962Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689703922696 (+734 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689703922696Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689703922697 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689703922707 (+10 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689703922726 (+19 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689703922940 (+214 ms) 2023-07-18 18:12:02,948 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 18:12:02,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 985 msec 2023-07-18 18:12:03,082 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:03,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:12:03,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:12:03,084 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703923084 2023-07-18 18:12:03,084 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35301, tgtDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703923084, rawTgtDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703923084, srcFsUri=hdfs://localhost:35301, srcDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:12:03,116 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:12:03,116 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2030913_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703923084, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703923084/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:03,117 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9, snapshotDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-18 18:12:03,123 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703923084/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:03,263 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,264 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,264 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,265 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,265 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,266 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,266 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,373 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/hadoop-8590751240508991414.jar 2023-07-18 18:12:03,374 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,374 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,375 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,375 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,376 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,376 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:03,377 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:12:03,377 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:12:03,377 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:12:03,378 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:12:03,378 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:12:03,379 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:12:03,379 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:12:03,379 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:12:03,380 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:12:03,380 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:12:03,380 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:12:03,381 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:12:03,381 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:12:03,381 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:12:03,381 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:12:03,382 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:12:03,382 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:12:04,001 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0005_000001 (auth:SIMPLE) 2023-07-18 18:12:05,728 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:12:05,777 WARN [DataStreamer for file /user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689703825988_0006/libjars/hbase-procedure-2.4.18-SNAPSHOT.jar block BP-379446697-172.31.14.131-1689703811876:blk_1073742175_1351] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.closeInternal(DataStreamer.java:844) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:840) 2023-07-18 18:12:05,778 WARN [Listener at jenkins-hbase4.apache.org/37995] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:12:05,782 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-18 18:12:06,068 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:12:06,068 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:12:06,901 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0006_000001 (auth:SIMPLE) 2023-07-18 18:12:12,202 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0006_000001 (auth:SIMPLE) 2023-07-18 18:12:15,195 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:12:15,196 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:12:15,206 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:15,206 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:12:15,206 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:12:15,207 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-859359611_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:15,207 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 18:12:15,207 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 18:12:15,207 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-859359611_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703923084/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703923084/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:15,208 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703923084/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 18:12:15,208 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703923084/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 18:12:15,212 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 18:12:15,219 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703935219"}]},"ts":"1689703935219"} 2023-07-18 18:12:15,220 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 18:12:15,223 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-18 18:12:15,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=88bf99ad509e5d6b47d59ae9aed1384a, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5671252cebad51664e6d1ccc5fa60f8, UNASSIGN}] 2023-07-18 18:12:15,226 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=88bf99ad509e5d6b47d59ae9aed1384a, UNASSIGN 2023-07-18 18:12:15,227 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5671252cebad51664e6d1ccc5fa60f8, UNASSIGN 2023-07-18 18:12:15,227 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=88bf99ad509e5d6b47d59ae9aed1384a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:15,227 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d5671252cebad51664e6d1ccc5fa60f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:15,227 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703935227"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703935227"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703935227"}]},"ts":"1689703935227"} 2023-07-18 18:12:15,227 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703935227"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703935227"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703935227"}]},"ts":"1689703935227"} 2023-07-18 18:12:15,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 88bf99ad509e5d6b47d59ae9aed1384a, server=jenkins-hbase4.apache.org,40677,1689703817386}] 2023-07-18 18:12:15,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure d5671252cebad51664e6d1ccc5fa60f8, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:12:15,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 18:12:15,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:15,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 88bf99ad509e5d6b47d59ae9aed1384a, disabling compactions & flushes 2023-07-18 18:12:15,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:15,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:15,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. after waiting 0 ms 2023-07-18 18:12:15,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:15,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:15,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d5671252cebad51664e6d1ccc5fa60f8, disabling compactions & flushes 2023-07-18 18:12:15,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:15,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:15,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. after waiting 0 ms 2023-07-18 18:12:15,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:15,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:12:15,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:15,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a. 2023-07-18 18:12:15,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 88bf99ad509e5d6b47d59ae9aed1384a: 2023-07-18 18:12:15,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:15,436 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=88bf99ad509e5d6b47d59ae9aed1384a, regionState=CLOSED 2023-07-18 18:12:15,436 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703935436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703935436"}]},"ts":"1689703935436"} 2023-07-18 18:12:15,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:12:15,440 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-18 18:12:15,440 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 88bf99ad509e5d6b47d59ae9aed1384a, server=jenkins-hbase4.apache.org,40677,1689703817386 in 208 msec 2023-07-18 18:12:15,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:15,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8. 2023-07-18 18:12:15,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d5671252cebad51664e6d1ccc5fa60f8: 2023-07-18 18:12:15,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=88bf99ad509e5d6b47d59ae9aed1384a, UNASSIGN in 216 msec 2023-07-18 18:12:15,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:15,445 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d5671252cebad51664e6d1ccc5fa60f8, regionState=CLOSED 2023-07-18 18:12:15,445 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703935445"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703935445"}]},"ts":"1689703935445"} 2023-07-18 18:12:15,451 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-18 18:12:15,451 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure d5671252cebad51664e6d1ccc5fa60f8, server=jenkins-hbase4.apache.org,34171,1689703817322 in 217 msec 2023-07-18 18:12:15,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-18 18:12:15,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d5671252cebad51664e6d1ccc5fa60f8, UNASSIGN in 227 msec 2023-07-18 18:12:15,455 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703935455"}]},"ts":"1689703935455"} 2023-07-18 18:12:15,457 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 18:12:15,459 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-18 18:12:15,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 248 msec 2023-07-18 18:12:15,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 18:12:15,522 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-18 18:12:15,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,529 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,531 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,532 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,537 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:15,537 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:15,538 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,538 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,538 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,538 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 18:12:15,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 18:12:15,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 18:12:15,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 18:12:15,541 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/recovered.edits] 2023-07-18 18:12:15,542 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/recovered.edits] 2023-07-18 18:12:15,543 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,543 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,543 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:15,543 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:15,543 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,543 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:15,543 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,543 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:15,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 18:12:15,549 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/cf/fc110312fc7d44fcaa4f95f78d14a44e to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/cf/fc110312fc7d44fcaa4f95f78d14a44e 2023-07-18 18:12:15,567 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/cf/b9a7123ab98f4b1281b648239f43b4fc to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/cf/b9a7123ab98f4b1281b648239f43b4fc 2023-07-18 18:12:15,571 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/recovered.edits/9.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8/recovered.edits/9.seqid 2023-07-18 18:12:15,572 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/d5671252cebad51664e6d1ccc5fa60f8 2023-07-18 18:12:15,575 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/recovered.edits/9.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a/recovered.edits/9.seqid 2023-07-18 18:12:15,576 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testEmptyExportFileSystemState/88bf99ad509e5d6b47d59ae9aed1384a 2023-07-18 18:12:15,576 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 18:12:15,577 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-18 18:12:15,578 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-18 18:12:15,584 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307189aff5540d6d54843bd29b0a8f9659ad1 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307189aff5540d6d54843bd29b0a8f9659ad1 2023-07-18 18:12:15,587 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307186419a28f208543689b395be6bb722640 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307186419a28f208543689b395be6bb722640 2023-07-18 18:12:15,587 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-18 18:12:15,596 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,608 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-18 18:12:15,629 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-18 18:12:15,635 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,635 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-18 18:12:15,636 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703935636"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:15,636 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703935636"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:15,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 18:12:15,653 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 18:12:15,653 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 88bf99ad509e5d6b47d59ae9aed1384a, NAME => 'testtb-testEmptyExportFileSystemState,,1689703920782.88bf99ad509e5d6b47d59ae9aed1384a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d5671252cebad51664e6d1ccc5fa60f8, NAME => 'testtb-testEmptyExportFileSystemState,1,1689703920782.d5671252cebad51664e6d1ccc5fa60f8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 18:12:15,653 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-18 18:12:15,653 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703935653"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:15,669 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-18 18:12:15,671 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:15,673 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 148 msec 2023-07-18 18:12:15,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 18:12:15,847 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-18 18:12:15,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-18 18:12:15,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:15,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-18 18:12:15,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:15,891 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761 (was 759) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:52546 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:47712 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_597041017_1 at /127.0.0.1:52520 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:40471 from appattempt_1689703825988_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:42909 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:53052 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4789 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=566 (was 549) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1492 (was 2292) 2023-07-18 18:12:15,891 WARN [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-18 18:12:15,921 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=566, ProcessCount=184, AvailableMemoryMB=1492 2023-07-18 18:12:15,921 WARN [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-18 18:12:15,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 18:12:15,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:15,930 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:12:15,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-18 18:12:15,931 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:12:15,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 18:12:15,934 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:15,934 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:15,934 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a empty. 2023-07-18 18:12:15,935 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74 empty. 2023-07-18 18:12:15,936 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:15,936 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:15,936 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 18:12:15,948 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-18 18:12:15,950 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 42878ffc087115bf39fc41cad05d754a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:12:15,950 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 234159a469ac4ca76566f2b513a75d74, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp 2023-07-18 18:12:15,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:12:15,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 42878ffc087115bf39fc41cad05d754a, disabling compactions & flushes 2023-07-18 18:12:15,960 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:15,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:15,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. after waiting 0 ms 2023-07-18 18:12:15,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:15,960 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:15,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 42878ffc087115bf39fc41cad05d754a: 2023-07-18 18:12:15,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:12:15,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 234159a469ac4ca76566f2b513a75d74, disabling compactions & flushes 2023-07-18 18:12:15,960 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:15,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:15,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. after waiting 0 ms 2023-07-18 18:12:15,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:15,960 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:15,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 234159a469ac4ca76566f2b513a75d74: 2023-07-18 18:12:15,962 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:12:15,964 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703935964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703935964"}]},"ts":"1689703935964"} 2023-07-18 18:12:15,964 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703935964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703935964"}]},"ts":"1689703935964"} 2023-07-18 18:12:15,977 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:12:15,978 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:12:15,978 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703935978"}]},"ts":"1689703935978"} 2023-07-18 18:12:15,979 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-18 18:12:15,983 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:12:15,984 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:12:15,984 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:12:15,984 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:12:15,984 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:12:15,985 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=234159a469ac4ca76566f2b513a75d74, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42878ffc087115bf39fc41cad05d754a, ASSIGN}] 2023-07-18 18:12:15,988 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42878ffc087115bf39fc41cad05d754a, ASSIGN 2023-07-18 18:12:15,988 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=234159a469ac4ca76566f2b513a75d74, ASSIGN 2023-07-18 18:12:15,988 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42878ffc087115bf39fc41cad05d754a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34171,1689703817322; forceNewPlan=false, retain=false 2023-07-18 18:12:15,989 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=234159a469ac4ca76566f2b513a75d74, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39949,1689703817554; forceNewPlan=false, retain=false 2023-07-18 18:12:16,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 18:12:16,139 INFO [jenkins-hbase4:40369] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:12:16,142 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=42878ffc087115bf39fc41cad05d754a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,142 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=234159a469ac4ca76566f2b513a75d74, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,142 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703936142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703936142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703936142"}]},"ts":"1689703936142"} 2023-07-18 18:12:16,143 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703936142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703936142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703936142"}]},"ts":"1689703936142"} 2023-07-18 18:12:16,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 42878ffc087115bf39fc41cad05d754a, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:12:16,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 234159a469ac4ca76566f2b513a75d74, server=jenkins-hbase4.apache.org,39949,1689703817554}] 2023-07-18 18:12:16,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 18:12:16,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:16,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 234159a469ac4ca76566f2b513a75d74, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 18:12:16,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:16,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 42878ffc087115bf39fc41cad05d754a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 18:12:16,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. service=AccessControlService 2023-07-18 18:12:16,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. service=AccessControlService 2023-07-18 18:12:16,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:12:16,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:12:16,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:16,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:16,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:12:16,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:16,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:16,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:12:16,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:16,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:16,311 INFO [StoreOpener-234159a469ac4ca76566f2b513a75d74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:16,311 INFO [StoreOpener-42878ffc087115bf39fc41cad05d754a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:16,312 DEBUG [StoreOpener-234159a469ac4ca76566f2b513a75d74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/cf 2023-07-18 18:12:16,312 DEBUG [StoreOpener-234159a469ac4ca76566f2b513a75d74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/cf 2023-07-18 18:12:16,313 DEBUG [StoreOpener-42878ffc087115bf39fc41cad05d754a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/cf 2023-07-18 18:12:16,313 DEBUG [StoreOpener-42878ffc087115bf39fc41cad05d754a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/cf 2023-07-18 18:12:16,313 INFO [StoreOpener-234159a469ac4ca76566f2b513a75d74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 234159a469ac4ca76566f2b513a75d74 columnFamilyName cf 2023-07-18 18:12:16,313 INFO [StoreOpener-42878ffc087115bf39fc41cad05d754a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42878ffc087115bf39fc41cad05d754a columnFamilyName cf 2023-07-18 18:12:16,314 INFO [StoreOpener-234159a469ac4ca76566f2b513a75d74-1] regionserver.HStore(310): Store=234159a469ac4ca76566f2b513a75d74/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:12:16,314 INFO [StoreOpener-42878ffc087115bf39fc41cad05d754a-1] regionserver.HStore(310): Store=42878ffc087115bf39fc41cad05d754a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:12:16,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:16,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:16,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:16,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:16,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:16,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:16,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:12:16,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:12:16,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 42878ffc087115bf39fc41cad05d754a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73083010, jitterRate=0.0890217125415802}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:12:16,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 234159a469ac4ca76566f2b513a75d74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59990758, jitterRate=-0.10606804490089417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:12:16,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 42878ffc087115bf39fc41cad05d754a: 2023-07-18 18:12:16,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 234159a469ac4ca76566f2b513a75d74: 2023-07-18 18:12:16,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a., pid=108, masterSystemTime=1689703936296 2023-07-18 18:12:16,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74., pid=109, masterSystemTime=1689703936296 2023-07-18 18:12:16,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:16,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:16,327 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=234159a469ac4ca76566f2b513a75d74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:16,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:16,328 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703936327"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703936327"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703936327"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703936327"}]},"ts":"1689703936327"} 2023-07-18 18:12:16,328 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=42878ffc087115bf39fc41cad05d754a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,328 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703936328"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703936328"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703936328"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703936328"}]},"ts":"1689703936328"} 2023-07-18 18:12:16,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-18 18:12:16,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 234159a469ac4ca76566f2b513a75d74, server=jenkins-hbase4.apache.org,39949,1689703817554 in 184 msec 2023-07-18 18:12:16,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-18 18:12:16,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 42878ffc087115bf39fc41cad05d754a, server=jenkins-hbase4.apache.org,34171,1689703817322 in 186 msec 2023-07-18 18:12:16,332 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=234159a469ac4ca76566f2b513a75d74, ASSIGN in 346 msec 2023-07-18 18:12:16,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-18 18:12:16,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42878ffc087115bf39fc41cad05d754a, ASSIGN in 346 msec 2023-07-18 18:12:16,333 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:12:16,334 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703936334"}]},"ts":"1689703936334"} 2023-07-18 18:12:16,338 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-18 18:12:16,347 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:12:16,347 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-18 18:12:16,349 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 18:12:16,350 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:16,350 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:16,350 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:16,350 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:16,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:16,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:16,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:16,353 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:16,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 427 msec 2023-07-18 18:12:16,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 18:12:16,536 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-18 18:12:16,539 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,539 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:16,541 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:12:16,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 18:12:16,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703936564 (current time:1689703936564). 2023-07-18 18:12:16,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:12:16,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x743105d3 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:12:16,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bc72894, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:12:16,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:12:16,581 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:12:16,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x743105d3 to 127.0.0.1:57608 2023-07-18 18:12:16,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:16,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x2c2fc751 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:12:16,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50cc409a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:12:16,592 DEBUG [hconnection-0x322d519f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:12:16,593 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:12:16,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c2fc751 to 127.0.0.1:57608 2023-07-18 18:12:16,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:16,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 18:12:16,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:12:16,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 18:12:16,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 18:12:16,602 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 18:12:16,602 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689704536602 2023-07-18 18:12:16,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 18:12:16,604 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:12:16,604 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:12:16,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 18:12:16,608 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 18:12:16,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-18 18:12:16,610 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 18:12:16,611 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689704536611 2023-07-18 18:12:16,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,627 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 18:12:16,627 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:16,628 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 18:12:16,628 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 18:12:16,702 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,702 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,703 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:16,703 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:16,703 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:16,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:16,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:16,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:16,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:16,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:16,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:16,703 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,704 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:16,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,705 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,705 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 18:12:16,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:12:16,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 18:12:16,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,706 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:12:16,706 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 18:12:16,706 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,706 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:12:16,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 18:12:16,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,706 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 18:12:16,707 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 18:12:16,707 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:16,707 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,708 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 18:12:16,708 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 18:12:16,708 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 18:12:16,709 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 18:12:16,709 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:16,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 18:12:16,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,710 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 18:12:16,711 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 18:12:16,711 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 18:12:16,711 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 18:12:16,711 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,711 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 18:12:16,711 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:16,712 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 18:12:16,712 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 18:12:16,712 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 18:12:16,717 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,717 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:16,718 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:16,718 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,718 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:16,719 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,719 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,719 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,719 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:16,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:16,719 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,719 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:16,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:16,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:16,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 18:12:16,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@322cfd4[Count = 1] remaining members to acquire global barrier 2023-07-18 18:12:16,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:16,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:16,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:16,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:16,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:16,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:16,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 18:12:16,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@322cfd4[Count = 0] remaining members to acquire global barrier 2023-07-18 18:12:16,724 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 18:12:16,725 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,726 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,726 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,726 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,726 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 18:12:16,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,726 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:12:16,726 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 18:12:16,726 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:16,726 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:12:16,726 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 18:12:16,727 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. started... 2023-07-18 18:12:16,727 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 18:12:16,727 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:12:16,728 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:12:16,728 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:12:16,728 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:16,729 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. started... 2023-07-18 18:12:16,729 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 234159a469ac4ca76566f2b513a75d74: 2023-07-18 18:12:16,729 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,729 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:12:16,729 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:12:16,731 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,733 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 18:12:16,733 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:16,733 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 18:12:16,733 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,733 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:12:16,740 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42878ffc087115bf39fc41cad05d754a: 2023-07-18 18:12:16,740 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,740 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:12:16,740 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:12:16,757 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. completed. 2023-07-18 18:12:16,757 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:16,758 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:12:16,758 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:12:16,758 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,758 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 18:12:16,758 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:12:16,760 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 18:12:16,760 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:16,760 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,760 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 18:12:16,762 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. completed. 2023-07-18 18:12:16,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:16,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:16,762 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:16,762 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:12:16,762 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:12:16,762 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,762 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 18:12:16,762 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:12:16,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:16,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:16,764 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,764 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 18:12:16,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,764 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:16,764 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 18:12:16,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:16,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39949,1689703817554': 2023-07-18 18:12:16,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 18:12:16,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:16,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:16,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:16,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:16,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:16,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:16,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:16,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34171,1689703817322': 2023-07-18 18:12:16,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 18:12:16,773 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 18:12:16,773 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:12:16,773 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:12:16,773 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,773 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:12:16,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:16,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:16,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:16,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:16,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:16,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,775 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:16,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,775 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:16,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:16,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:16,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:16,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:16,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,779 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:16,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:16,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,780 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:16,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:16,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:16,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,781 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,782 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,782 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:16,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:16,786 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:16,786 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,786 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:16,786 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:16,786 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:16,786 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:16,786 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:16,786 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,786 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:16,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:16,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:16,786 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:16,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:16,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:16,788 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:16,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,788 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:16,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 18:12:16,787 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,789 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,789 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:16,789 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,789 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:16,789 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:16,789 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,789 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:16,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 18:12:16,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:16,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:16,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:16,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,889 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 18:12:16,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,890 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689703936602Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689703936797 (+195 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689703936797Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689703936797Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689703936802 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689703936834 (+32 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689703936889 (+55 ms) 2023-07-18 18:12:16,893 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 18:12:16,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 290 msec 2023-07-18 18:12:16,906 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:16,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 18:12:16,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:12:16,910 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39949] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:12:16,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34171] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:12:16,916 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:16,916 DEBUG [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:16,916 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:12:16,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 18:12:16,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703936927 (current time:1689703936927). 2023-07-18 18:12:16,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:12:16,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x67f48f90 to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:12:16,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f8d8b58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:12:16,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:12:16,962 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:12:16,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67f48f90 to 127.0.0.1:57608 2023-07-18 18:12:16,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:16,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(139): Connect 0x57f5f0aa to 127.0.0.1:57608 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:12:16,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14be6dcb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:12:16,980 DEBUG [hconnection-0x47baf34f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:12:16,994 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:12:17,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57f5f0aa to 127.0.0.1:57608 2023-07-18 18:12:17,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:17,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 18:12:17,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:12:17,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 18:12:17,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 18:12:17,007 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 18:12:17,008 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689704537008 2023-07-18 18:12:17,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 18:12:17,008 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,008 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:12:17,010 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:12:17,012 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 18:12:17,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 18:12:17,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-18 18:12:17,014 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 18:12:17,015 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689704537015 2023-07-18 18:12:17,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,046 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 18:12:17,046 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:17,048 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 18:12:17,048 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 18:12:17,048 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,048 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,050 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:17,050 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:17,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:17,050 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:17,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,051 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,051 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,051 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,051 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:12:17,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 18:12:17,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 18:12:17,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,052 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 18:12:17,052 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 18:12:17,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,052 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 18:12:17,052 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:17,052 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 18:12:17,054 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:17,054 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 18:12:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 18:12:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 18:12:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 18:12:17,054 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 18:12:17,056 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 18:12:17,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:17,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,058 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,058 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,058 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:17,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:17,059 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:17,059 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,059 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:17,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 18:12:17,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,060 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 18:12:17,060 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,060 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:17,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:17,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:17,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39949,1689703817554' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 18:12:17,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74f4a168[Count = 1] remaining members to acquire global barrier 2023-07-18 18:12:17,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:17,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:17,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:17,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:17,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:17,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,067 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 18:12:17,067 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:17,069 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 18:12:17,069 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 18:12:17,069 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1689703817386' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 18:12:17,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34171,1689703817322' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 18:12:17,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74f4a168[Count = 0] remaining members to acquire global barrier 2023-07-18 18:12:17,070 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 18:12:17,070 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,071 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,071 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,071 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 18:12:17,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,072 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 18:12:17,072 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:12:17,072 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:12:17,072 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:17,072 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. started... 2023-07-18 18:12:17,072 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 234159a469ac4ca76566f2b513a75d74 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-18 18:12:17,073 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:12:17,073 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:12:17,073 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:17,073 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. started... 2023-07-18 18:12:17,073 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 42878ffc087115bf39fc41cad05d754a 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-18 18:12:17,078 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,078 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,078 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,078 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,078 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:12:17,078 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,078 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:17,078 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 18:12:17,078 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 18:12:17,078 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40677,1689703817386' in zk 2023-07-18 18:12:17,080 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 18:12:17,080 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:17,080 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1689703817386' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 18:12:17,110 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:17,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 18:12:17,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:12:17,112 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:12:17,151 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307184eb1c5cc30b2402cab8d67f4f8b4666b to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307184eb1c5cc30b2402cab8d67f4f8b4666b 2023-07-18 18:12:17,158 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307186b9bfe782c444d39879fb85b5856d47e to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307186b9bfe782c444d39879fb85b5856d47e 2023-07-18 18:12:17,162 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/.tmp/cf/17db34211fdb4e668dfb31bd5ded5044 2023-07-18 18:12:17,168 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/.tmp/cf/17db34211fdb4e668dfb31bd5ded5044 as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/cf/17db34211fdb4e668dfb31bd5ded5044 2023-07-18 18:12:17,175 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/.tmp/cf/4b6b46624d0a4dd9abf7611e5e717b61 2023-07-18 18:12:17,175 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/cf/17db34211fdb4e668dfb31bd5ded5044, entries=5, sequenceid=6, filesize=5.8 K 2023-07-18 18:12:17,176 INFO [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 234159a469ac4ca76566f2b513a75d74 in 104ms, sequenceid=6, compaction requested=false 2023-07-18 18:12:17,176 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-18 18:12:17,177 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 234159a469ac4ca76566f2b513a75d74: 2023-07-18 18:12:17,177 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,177 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:12:17,177 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/cf/17db34211fdb4e668dfb31bd5ded5044] hfiles 2023-07-18 18:12:17,177 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/cf/17db34211fdb4e668dfb31bd5ded5044 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,180 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/.tmp/cf/4b6b46624d0a4dd9abf7611e5e717b61 as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/cf/4b6b46624d0a4dd9abf7611e5e717b61 2023-07-18 18:12:17,192 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/cf/4b6b46624d0a4dd9abf7611e5e717b61, entries=45, sequenceid=6, filesize=13.0 K 2023-07-18 18:12:17,198 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. completed. 2023-07-18 18:12:17,199 DEBUG [rs(jenkins-hbase4.apache.org,39949,1689703817554)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:17,199 INFO [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 42878ffc087115bf39fc41cad05d754a in 126ms, sequenceid=6, compaction requested=false 2023-07-18 18:12:17,199 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:12:17,199 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:12:17,201 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42878ffc087115bf39fc41cad05d754a: 2023-07-18 18:12:17,201 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,201 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 18:12:17,201 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39949,1689703817554' in zk 2023-07-18 18:12:17,201 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,201 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:12:17,201 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/cf/4b6b46624d0a4dd9abf7611e5e717b61] hfiles 2023-07-18 18:12:17,201 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/cf/4b6b46624d0a4dd9abf7611e5e717b61 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,203 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,203 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 18:12:17,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:17,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:17,203 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:17,203 DEBUG [member: 'jenkins-hbase4.apache.org,39949,1689703817554' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 18:12:17,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:17,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:17,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:17,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:17,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:17,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39949,1689703817554': 2023-07-18 18:12:17,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39949,1689703817554' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 18:12:17,210 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. completed. 2023-07-18 18:12:17,210 DEBUG [rs(jenkins-hbase4.apache.org,34171,1689703817322)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:17,211 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:12:17,211 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:12:17,211 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,211 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 18:12:17,211 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34171,1689703817322' in zk 2023-07-18 18:12:17,212 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:17,212 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 18:12:17,212 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:17,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:17,212 DEBUG [member: 'jenkins-hbase4.apache.org,34171,1689703817322' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 18:12:17,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:17,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:17,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:17,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:17,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34171,1689703817322': 2023-07-18 18:12:17,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34171,1689703817322' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 18:12:17,218 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 18:12:17,218 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:12:17,218 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:12:17,218 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,218 INFO [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:12:17,220 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,220 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,220 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,220 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:17,220 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,220 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:17,221 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,221 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:17,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:17,221 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:17,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,222 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:17,224 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:17,224 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,224 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:17,227 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:17,227 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,227 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:17,227 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,227 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:17,227 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:17,227 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:17,227 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:17,227 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:17,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:17,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:17,227 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,228 DEBUG [(jenkins-hbase4.apache.org,40369,1689703815902)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:17,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:17,228 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,229 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:12:17,230 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,230 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:17,228 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:17,227 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:17,230 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,230 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:17,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:17,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 18:12:17,230 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,230 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:17,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:17,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:17,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:17,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:17,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:17,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307186b9bfe782c444d39879fb85b5856d47e, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307184eb1c5cc30b2402cab8d67f4f8b4666b] mob files 2023-07-18 18:12:17,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307186b9bfe782c444d39879fb85b5856d47e 2023-07-18 18:12:17,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307184eb1c5cc30b2402cab8d67f4f8b4666b 2023-07-18 18:12:17,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,312 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:17,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 18:12:17,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:12:17,314 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:12:17,341 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 18:12:17,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,341 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689703937008Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689703937245 (+237 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689703937245Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689703937245Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689703937255 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689703937283 (+28 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689703937341 (+58 ms) 2023-07-18 18:12:17,345 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 18:12:17,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 335 msec 2023-07-18 18:12:17,614 DEBUG [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:17,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 18:12:17,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:12:17,616 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703937616 2023-07-18 18:12:17,616 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35301, tgtDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703937616, rawTgtDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703937616, srcFsUri=hdfs://localhost:35301, srcDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:12:17,650 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9 2023-07-18 18:12:17,650 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1787742842_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703937616, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703937616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,650 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35301, inputRoot=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9, snapshotDir=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-18 18:12:17,661 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703937616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:17,688 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,689 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,690 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,690 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,691 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,691 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,692 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,791 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/hadoop-3876989968024276326.jar 2023-07-18 18:12:17,792 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,792 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,793 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,793 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,794 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,794 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:17,795 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:12:17,796 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:12:17,796 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:12:17,797 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:12:17,797 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:12:17,798 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:12:17,798 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:12:17,799 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:12:17,799 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:12:17,800 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:12:17,801 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:12:17,801 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:12:17,802 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:12:17,802 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:12:17,802 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:12:17,803 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:12:17,804 DEBUG [Listener at jenkins-hbase4.apache.org/37995] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:12:19,221 WARN [Listener at jenkins-hbase4.apache.org/37995] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:12:19,224 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-18 18:12:19,226 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-18 18:12:19,718 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:12:19,718 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:12:19,730 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0006_000001 (auth:SIMPLE) 2023-07-18 18:12:20,033 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0007_000001 (auth:SIMPLE) 2023-07-18 18:12:21,034 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:12:26,083 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0007_000001 (auth:SIMPLE) 2023-07-18 18:12:28,407 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0007_000001 (auth:SIMPLE) 2023-07-18 18:12:32,553 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825988_0007_000001 (auth:SIMPLE) 2023-07-18 18:12:34,565 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:12:34,565 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:12:34,601 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,601 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:12:34,602 INFO [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:12:34,603 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-859359611_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,604 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 18:12:34,604 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 18:12:34,604 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-859359611_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703937616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703937616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,604 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703937616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 18:12:34,604 DEBUG [Listener at jenkins-hbase4.apache.org/37995] snapshot.TestExportSnapshot(367): hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/export-test/export-1689703937616/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 18:12:34,613 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 18:12:34,620 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703954619"}]},"ts":"1689703954619"} 2023-07-18 18:12:34,621 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-18 18:12:34,623 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-18 18:12:34,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=234159a469ac4ca76566f2b513a75d74, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42878ffc087115bf39fc41cad05d754a, UNASSIGN}] 2023-07-18 18:12:34,627 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42878ffc087115bf39fc41cad05d754a, UNASSIGN 2023-07-18 18:12:34,627 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=234159a469ac4ca76566f2b513a75d74, UNASSIGN 2023-07-18 18:12:34,629 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=42878ffc087115bf39fc41cad05d754a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:12:34,629 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=234159a469ac4ca76566f2b513a75d74, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:12:34,629 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703954629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703954629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703954629"}]},"ts":"1689703954629"} 2023-07-18 18:12:34,629 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703954629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703954629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703954629"}]},"ts":"1689703954629"} 2023-07-18 18:12:34,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 42878ffc087115bf39fc41cad05d754a, server=jenkins-hbase4.apache.org,34171,1689703817322}] 2023-07-18 18:12:34,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 234159a469ac4ca76566f2b513a75d74, server=jenkins-hbase4.apache.org,39949,1689703817554}] 2023-07-18 18:12:34,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 18:12:34,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:34,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 42878ffc087115bf39fc41cad05d754a, disabling compactions & flushes 2023-07-18 18:12:34,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:34,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:34,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. after waiting 0 ms 2023-07-18 18:12:34,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:34,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:34,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 234159a469ac4ca76566f2b513a75d74, disabling compactions & flushes 2023-07-18 18:12:34,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:34,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:34,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. after waiting 0 ms 2023-07-18 18:12:34,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:34,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:12:34,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:34,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a. 2023-07-18 18:12:34,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 42878ffc087115bf39fc41cad05d754a: 2023-07-18 18:12:34,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:34,839 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=42878ffc087115bf39fc41cad05d754a, regionState=CLOSED 2023-07-18 18:12:34,839 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703954839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703954839"}]},"ts":"1689703954839"} 2023-07-18 18:12:34,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:12:34,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:34,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74. 2023-07-18 18:12:34,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 234159a469ac4ca76566f2b513a75d74: 2023-07-18 18:12:34,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:34,844 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=234159a469ac4ca76566f2b513a75d74, regionState=CLOSED 2023-07-18 18:12:34,844 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703954844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703954844"}]},"ts":"1689703954844"} 2023-07-18 18:12:34,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-18 18:12:34,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 42878ffc087115bf39fc41cad05d754a, server=jenkins-hbase4.apache.org,34171,1689703817322 in 211 msec 2023-07-18 18:12:34,851 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=42878ffc087115bf39fc41cad05d754a, UNASSIGN in 221 msec 2023-07-18 18:12:34,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-18 18:12:34,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 234159a469ac4ca76566f2b513a75d74, server=jenkins-hbase4.apache.org,39949,1689703817554 in 216 msec 2023-07-18 18:12:34,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-18 18:12:34,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=234159a469ac4ca76566f2b513a75d74, UNASSIGN in 228 msec 2023-07-18 18:12:34,854 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703954854"}]},"ts":"1689703954854"} 2023-07-18 18:12:34,856 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-18 18:12:34,859 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-18 18:12:34,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 246 msec 2023-07-18 18:12:34,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 18:12:34,922 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-18 18:12:34,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,927 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,931 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,937 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39949] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,941 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,941 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,941 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,941 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,942 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 18:12:34,942 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 18:12:34,943 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 18:12:34,943 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:34,943 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 18:12:34,945 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:34,946 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/recovered.edits] 2023-07-18 18:12:34,948 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/cf, FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/recovered.edits] 2023-07-18 18:12:34,949 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,949 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,949 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:34,949 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,949 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,950 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:34,950 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:34,949 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:34,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 18:12:34,955 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/cf/17db34211fdb4e668dfb31bd5ded5044 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/cf/17db34211fdb4e668dfb31bd5ded5044 2023-07-18 18:12:34,956 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/cf/4b6b46624d0a4dd9abf7611e5e717b61 to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/cf/4b6b46624d0a4dd9abf7611e5e717b61 2023-07-18 18:12:34,959 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/recovered.edits/9.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74/recovered.edits/9.seqid 2023-07-18 18:12:34,959 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/recovered.edits/9.seqid to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a/recovered.edits/9.seqid 2023-07-18 18:12:34,960 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/234159a469ac4ca76566f2b513a75d74 2023-07-18 18:12:34,960 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/42878ffc087115bf39fc41cad05d754a 2023-07-18 18:12:34,960 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 18:12:34,960 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-18 18:12:34,961 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-18 18:12:34,965 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307186b9bfe782c444d39879fb85b5856d47e to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307186b9bfe782c444d39879fb85b5856d47e 2023-07-18 18:12:34,967 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307184eb1c5cc30b2402cab8d67f4f8b4666b to hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307184eb1c5cc30b2402cab8d67f4f8b4666b 2023-07-18 18:12:34,967 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-18 18:12:34,974 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,977 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-18 18:12:34,979 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-18 18:12:34,980 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,980 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-18 18:12:34,980 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703954980"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:34,980 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703954980"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:34,982 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 18:12:34,982 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 234159a469ac4ca76566f2b513a75d74, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689703935925.234159a469ac4ca76566f2b513a75d74.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 42878ffc087115bf39fc41cad05d754a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689703935925.42878ffc087115bf39fc41cad05d754a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 18:12:34,982 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-18 18:12:34,982 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703954982"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:34,992 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-18 18:12:34,996 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:34,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 72 msec 2023-07-18 18:12:35,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 18:12:35,056 INFO [Listener at jenkins-hbase4.apache.org/37995] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-18 18:12:35,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 18:12:35,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:35,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 18:12:35,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40369] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:35,113 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 761) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1865067305_1 at /127.0.0.1:54898 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:43840 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:54932 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-859359611_17 at /127.0.0.1:38852 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5428 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x70d141d6-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1244863887) connection to jenkins-hbase4.apache.org/172.31.14.131:42069 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 920), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=627 (was 566) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1612 (was 1492) - AvailableMemoryMB LEAK? - 2023-07-18 18:12:35,113 WARN [Listener at jenkins-hbase4.apache.org/37995] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-18 18:12:35,113 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-18 18:12:35,140 INFO [Listener at jenkins-hbase4.apache.org/37995] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 18:12:35,283 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689703825988_0007_01_000001 is : 143 2023-07-18 18:12:40,406 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:12:49,269 INFO [Listener at jenkins-hbase4.apache.org/37995] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 18:13:03,396 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 18:13:03,396 INFO [Listener at jenkins-hbase4.apache.org/37995] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 18:13:03,519 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-18 18:13:03,534 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-18 18:13:03,536 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 18:13:03,578 INFO [Listener at jenkins-hbase4.apache.org/37995] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 18:13:03,684 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 18:13:03,684 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-18 18:13:03,684 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-18 18:13:03,684 INFO [Listener at jenkins-hbase4.apache.org/37995] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-18 18:13:03,685 DEBUG [Listener at jenkins-hbase4.apache.org/37995] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x722ff5ad to 127.0.0.1:57608 2023-07-18 18:13:03,685 DEBUG [Listener at jenkins-hbase4.apache.org/37995] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:13:03,685 DEBUG [Listener at jenkins-hbase4.apache.org/37995] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-18 18:13:03,685 DEBUG [Listener at jenkins-hbase4.apache.org/37995] util.JVMClusterUtil(257): Found active master hash=145868615, stopped=false 2023-07-18 18:13:03,685 DEBUG [Listener at jenkins-hbase4.apache.org/37995] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:13:03,685 DEBUG [Listener at jenkins-hbase4.apache.org/37995] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 18:13:03,685 INFO [Listener at jenkins-hbase4.apache.org/37995] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40369,1689703815902 2023-07-18 18:13:03,692 INFO [Listener at jenkins-hbase4.apache.org/37995] procedure2.ProcedureExecutor(629): Stopping 2023-07-18 18:13:03,692 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:13:03,692 DEBUG [Listener at jenkins-hbase4.apache.org/37995] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53dd3f70 to 127.0.0.1:57608 2023-07-18 18:13:03,692 DEBUG [Listener at jenkins-hbase4.apache.org/37995] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:13:03,693 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:13:03,693 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:13:03,693 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:13:03,692 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:13:03,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:13:03,693 INFO [Listener at jenkins-hbase4.apache.org/37995] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34171,1689703817322' ***** 2023-07-18 18:13:03,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:13:03,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:13:03,694 DEBUG [Listener at jenkins-hbase4.apache.org/37995] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:13:03,694 INFO [Listener at jenkins-hbase4.apache.org/37995] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:13:03,694 INFO [Listener at jenkins-hbase4.apache.org/37995] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40677,1689703817386' ***** 2023-07-18 18:13:03,694 DEBUG [Listener at jenkins-hbase4.apache.org/37995] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:13:03,694 INFO [Listener at jenkins-hbase4.apache.org/37995] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:13:03,694 INFO [Listener at jenkins-hbase4.apache.org/37995] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39949,1689703817554' ***** 2023-07-18 18:13:03,694 INFO [RS:1;jenkins-hbase4:40677] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:13:03,695 DEBUG [Listener at jenkins-hbase4.apache.org/37995] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:13:03,695 INFO [Listener at jenkins-hbase4.apache.org/37995] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:13:03,695 INFO [RS:1;jenkins-hbase4:40677] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:13:03,695 INFO [RS:1;jenkins-hbase4:40677] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:13:03,695 INFO [RS:2;jenkins-hbase4:39949] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:13:03,695 INFO [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:13:03,696 INFO [RS:2;jenkins-hbase4:39949] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:13:03,696 DEBUG [RS:1;jenkins-hbase4:40677] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x255f7fab to 127.0.0.1:57608 2023-07-18 18:13:03,696 DEBUG [RS:1;jenkins-hbase4:40677] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:13:03,696 INFO [RS:2;jenkins-hbase4:39949] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:13:03,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:13:03,704 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:13:03,696 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:13:03,696 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:13:03,704 INFO [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(3305): Received CLOSE for b7f6db75c1d50b5b19e0581fc19406b6 2023-07-18 18:13:03,706 INFO [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40677,1689703817386; all regions closed. 2023-07-18 18:13:03,706 INFO [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:13:03,706 DEBUG [RS:2;jenkins-hbase4:39949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x327fa770 to 127.0.0.1:57608 2023-07-18 18:13:03,706 DEBUG [RS:2;jenkins-hbase4:39949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:13:03,716 INFO [RS:0;jenkins-hbase4:34171] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:13:03,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b7f6db75c1d50b5b19e0581fc19406b6, disabling compactions & flushes 2023-07-18 18:13:03,720 INFO [RS:0;jenkins-hbase4:34171] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:13:03,720 INFO [RS:0;jenkins-hbase4:34171] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:13:03,720 INFO [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(3305): Received CLOSE for f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:13:03,721 INFO [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:13:03,721 DEBUG [RS:0;jenkins-hbase4:34171] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5389828c to 127.0.0.1:57608 2023-07-18 18:13:03,721 DEBUG [RS:0;jenkins-hbase4:34171] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:13:03,721 INFO [RS:2;jenkins-hbase4:39949] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:13:03,720 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:13:03,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. 2023-07-18 18:13:03,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. 2023-07-18 18:13:03,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. after waiting 0 ms 2023-07-18 18:13:03,722 INFO [RS:2;jenkins-hbase4:39949] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:13:03,722 INFO [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-18 18:13:03,723 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1478): Online Regions={f913cdf0e1eeea2ab791850e8be5efcb=hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb.} 2023-07-18 18:13:03,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f913cdf0e1eeea2ab791850e8be5efcb, disabling compactions & flushes 2023-07-18 18:13:03,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. 2023-07-18 18:13:03,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. 2023-07-18 18:13:03,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. after waiting 0 ms 2023-07-18 18:13:03,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. 2023-07-18 18:13:03,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f913cdf0e1eeea2ab791850e8be5efcb 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-18 18:13:03,724 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1504): Waiting on f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:13:03,722 INFO [RS:2;jenkins-hbase4:39949] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:13:03,724 INFO [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-18 18:13:03,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. 2023-07-18 18:13:03,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b7f6db75c1d50b5b19e0581fc19406b6 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-18 18:13:03,727 INFO [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-18 18:13:03,730 DEBUG [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, b7f6db75c1d50b5b19e0581fc19406b6=hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6.} 2023-07-18 18:13:03,733 DEBUG [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1504): Waiting on 1588230740, b7f6db75c1d50b5b19e0581fc19406b6 2023-07-18 18:13:03,743 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 18:13:03,743 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 18:13:03,743 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 18:13:03,743 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 18:13:03,743 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 18:13:03,743 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-18 18:13:03,776 DEBUG [RS:1;jenkins-hbase4:40677] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/oldWALs 2023-07-18 18:13:03,776 INFO [RS:1;jenkins-hbase4:40677] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40677%2C1689703817386:(num 1689703820320) 2023-07-18 18:13:03,776 DEBUG [RS:1;jenkins-hbase4:40677] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:13:03,776 INFO [RS:1;jenkins-hbase4:40677] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:13:03,789 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:13:03,795 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:13:03,811 INFO [RS:1;jenkins-hbase4:40677] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 18:13:03,811 INFO [RS:1;jenkins-hbase4:40677] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:13:03,811 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:13:03,811 INFO [RS:1;jenkins-hbase4:40677] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:13:03,811 INFO [RS:1;jenkins-hbase4:40677] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:13:03,821 INFO [RS:1;jenkins-hbase4:40677] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40677 2023-07-18 18:13:03,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6/.tmp/l/93f698a617c349c4887141ba884d9421 2023-07-18 18:13:03,861 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:13:03,861 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:13:03,861 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:13:03,861 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:13:03,861 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40677,1689703817386 2023-07-18 18:13:03,862 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:13:03,861 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:13:03,863 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40677,1689703817386] 2023-07-18 18:13:03,867 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40677,1689703817386; numProcessing=1 2023-07-18 18:13:03,871 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40677,1689703817386 already deleted, retry=false 2023-07-18 18:13:03,871 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40677,1689703817386 expired; onlineServers=2 2023-07-18 18:13:03,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/.tmp/info/c95055f98be944d6aa627a603fb2e30e 2023-07-18 18:13:03,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93f698a617c349c4887141ba884d9421 2023-07-18 18:13:03,880 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c95055f98be944d6aa627a603fb2e30e 2023-07-18 18:13:03,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6/.tmp/l/93f698a617c349c4887141ba884d9421 as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6/l/93f698a617c349c4887141ba884d9421 2023-07-18 18:13:03,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93f698a617c349c4887141ba884d9421 2023-07-18 18:13:03,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6/l/93f698a617c349c4887141ba884d9421, entries=7, sequenceid=18, filesize=5.2 K 2023-07-18 18:13:03,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for b7f6db75c1d50b5b19e0581fc19406b6 in 177ms, sequenceid=18, compaction requested=false 2023-07-18 18:13:03,927 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1504): Waiting on f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:13:03,932 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/.tmp/rep_barrier/a21a54d475de46ca9e2ed0ef6da9d731 2023-07-18 18:13:03,933 DEBUG [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1504): Waiting on 1588230740, b7f6db75c1d50b5b19e0581fc19406b6 2023-07-18 18:13:03,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/acl/b7f6db75c1d50b5b19e0581fc19406b6/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-18 18:13:03,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:13:03,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. 2023-07-18 18:13:03,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b7f6db75c1d50b5b19e0581fc19406b6: 2023-07-18 18:13:03,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689703822183.b7f6db75c1d50b5b19e0581fc19406b6. 2023-07-18 18:13:03,939 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a21a54d475de46ca9e2ed0ef6da9d731 2023-07-18 18:13:03,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/.tmp/table/844bd3ebc1ef429a8d4fbaeaec7307ff 2023-07-18 18:13:03,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 844bd3ebc1ef429a8d4fbaeaec7307ff 2023-07-18 18:13:03,958 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/.tmp/info/c95055f98be944d6aa627a603fb2e30e as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/info/c95055f98be944d6aa627a603fb2e30e 2023-07-18 18:13:03,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c95055f98be944d6aa627a603fb2e30e 2023-07-18 18:13:03,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/info/c95055f98be944d6aa627a603fb2e30e, entries=48, sequenceid=131, filesize=10.3 K 2023-07-18 18:13:03,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/.tmp/rep_barrier/a21a54d475de46ca9e2ed0ef6da9d731 as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/rep_barrier/a21a54d475de46ca9e2ed0ef6da9d731 2023-07-18 18:13:03,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a21a54d475de46ca9e2ed0ef6da9d731 2023-07-18 18:13:03,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/rep_barrier/a21a54d475de46ca9e2ed0ef6da9d731, entries=13, sequenceid=131, filesize=6.4 K 2023-07-18 18:13:03,968 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/.tmp/table/844bd3ebc1ef429a8d4fbaeaec7307ff as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/table/844bd3ebc1ef429a8d4fbaeaec7307ff 2023-07-18 18:13:03,969 INFO [RS:1;jenkins-hbase4:40677] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40677,1689703817386; zookeeper connection closed. 2023-07-18 18:13:03,969 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:13:03,969 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x10179a09a370002, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:13:03,969 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@35f050c2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@35f050c2 2023-07-18 18:13:03,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 844bd3ebc1ef429a8d4fbaeaec7307ff 2023-07-18 18:13:03,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/table/844bd3ebc1ef429a8d4fbaeaec7307ff, entries=24, sequenceid=131, filesize=6.9 K 2023-07-18 18:13:03,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 233ms, sequenceid=131, compaction requested=false 2023-07-18 18:13:03,991 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-18 18:13:03,992 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:13:03,992 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:13:03,993 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 18:13:03,993 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 18:13:03,993 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-18 18:13:04,097 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-18 18:13:04,098 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-18 18:13:04,128 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1504): Waiting on f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:13:04,133 INFO [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39949,1689703817554; all regions closed. 2023-07-18 18:13:04,135 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-18 18:13:04,135 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-18 18:13:04,148 DEBUG [RS:2;jenkins-hbase4:39949] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/oldWALs 2023-07-18 18:13:04,148 INFO [RS:2;jenkins-hbase4:39949] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39949%2C1689703817554.meta:.meta(num 1689703820889) 2023-07-18 18:13:04,188 DEBUG [RS:2;jenkins-hbase4:39949] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/oldWALs 2023-07-18 18:13:04,188 INFO [RS:2;jenkins-hbase4:39949] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39949%2C1689703817554:(num 1689703820299) 2023-07-18 18:13:04,188 DEBUG [RS:2;jenkins-hbase4:39949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:13:04,189 INFO [RS:2;jenkins-hbase4:39949] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:13:04,189 INFO [RS:2;jenkins-hbase4:39949] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 18:13:04,190 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:13:04,191 INFO [RS:2;jenkins-hbase4:39949] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39949 2023-07-18 18:13:04,193 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:13:04,193 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39949,1689703817554 2023-07-18 18:13:04,193 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:13:04,194 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39949,1689703817554] 2023-07-18 18:13:04,194 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39949,1689703817554; numProcessing=2 2023-07-18 18:13:04,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb/.tmp/info/a84c290008314eefbb279d61017e0410 2023-07-18 18:13:04,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb/.tmp/info/a84c290008314eefbb279d61017e0410 as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb/info/a84c290008314eefbb279d61017e0410 2023-07-18 18:13:04,295 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:13:04,295 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:39949-0x10179a09a370003, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:13:04,295 INFO [RS:2;jenkins-hbase4:39949] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39949,1689703817554; zookeeper connection closed. 2023-07-18 18:13:04,296 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39949,1689703817554 already deleted, retry=false 2023-07-18 18:13:04,296 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39949,1689703817554 expired; onlineServers=1 2023-07-18 18:13:04,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb/info/a84c290008314eefbb279d61017e0410, entries=2, sequenceid=6, filesize=4.8 K 2023-07-18 18:13:04,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f913cdf0e1eeea2ab791850e8be5efcb in 579ms, sequenceid=6, compaction requested=false 2023-07-18 18:13:04,323 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@72b655a7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@72b655a7 2023-07-18 18:13:04,328 DEBUG [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1504): Waiting on f913cdf0e1eeea2ab791850e8be5efcb 2023-07-18 18:13:04,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/data/hbase/namespace/f913cdf0e1eeea2ab791850e8be5efcb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:13:04,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:13:04,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. 2023-07-18 18:13:04,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f913cdf0e1eeea2ab791850e8be5efcb: 2023-07-18 18:13:04,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689703821277.f913cdf0e1eeea2ab791850e8be5efcb. 2023-07-18 18:13:04,528 INFO [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34171,1689703817322; all regions closed. 2023-07-18 18:13:04,574 DEBUG [RS:0;jenkins-hbase4:34171] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/oldWALs 2023-07-18 18:13:04,574 INFO [RS:0;jenkins-hbase4:34171] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34171%2C1689703817322:(num 1689703820305) 2023-07-18 18:13:04,574 DEBUG [RS:0;jenkins-hbase4:34171] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:13:04,574 INFO [RS:0;jenkins-hbase4:34171] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:13:04,574 INFO [RS:0;jenkins-hbase4:34171] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 18:13:04,575 INFO [RS:0;jenkins-hbase4:34171] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:13:04,575 INFO [RS:0;jenkins-hbase4:34171] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:13:04,575 INFO [RS:0;jenkins-hbase4:34171] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:13:04,575 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:13:04,576 INFO [RS:0;jenkins-hbase4:34171] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34171 2023-07-18 18:13:04,579 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34171,1689703817322 2023-07-18 18:13:04,579 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:13:04,580 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34171,1689703817322] 2023-07-18 18:13:04,581 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34171,1689703817322; numProcessing=3 2023-07-18 18:13:04,582 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34171,1689703817322 already deleted, retry=false 2023-07-18 18:13:04,583 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34171,1689703817322 expired; onlineServers=0 2023-07-18 18:13:04,583 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40369,1689703815902' ***** 2023-07-18 18:13:04,583 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-18 18:13:04,583 DEBUG [M:0;jenkins-hbase4:40369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@498ccd7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:13:04,583 INFO [M:0;jenkins-hbase4:40369] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40369,1689703815902 2023-07-18 18:13:04,583 INFO [M:0;jenkins-hbase4:40369] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40369,1689703815902; all regions closed. 2023-07-18 18:13:04,583 DEBUG [M:0;jenkins-hbase4:40369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:13:04,583 DEBUG [M:0;jenkins-hbase4:40369] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-18 18:13:04,583 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-18 18:13:04,583 DEBUG [M:0;jenkins-hbase4:40369] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-18 18:13:04,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689703819731] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689703819731,5,FailOnTimeoutGroup] 2023-07-18 18:13:04,583 INFO [M:0;jenkins-hbase4:40369] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-18 18:13:04,584 INFO [M:0;jenkins-hbase4:40369] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-18 18:13:04,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689703819741] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689703819741,5,FailOnTimeoutGroup] 2023-07-18 18:13:04,584 INFO [M:0;jenkins-hbase4:40369] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-18 18:13:04,584 DEBUG [M:0;jenkins-hbase4:40369] master.HMaster(1512): Stopping service threads 2023-07-18 18:13:04,584 INFO [M:0;jenkins-hbase4:40369] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-18 18:13:04,584 ERROR [M:0;jenkins-hbase4:40369] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-18 18:13:04,585 INFO [M:0;jenkins-hbase4:40369] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-18 18:13:04,585 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-18 18:13:04,586 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-18 18:13:04,586 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:13:04,587 DEBUG [M:0;jenkins-hbase4:40369] zookeeper.ZKUtil(398): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-18 18:13:04,587 WARN [M:0;jenkins-hbase4:40369] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-18 18:13:04,587 INFO [M:0;jenkins-hbase4:40369] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-18 18:13:04,587 INFO [M:0;jenkins-hbase4:40369] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-18 18:13:04,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:13:04,588 DEBUG [M:0;jenkins-hbase4:40369] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 18:13:04,588 INFO [M:0;jenkins-hbase4:40369] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:13:04,588 DEBUG [M:0;jenkins-hbase4:40369] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:13:04,588 DEBUG [M:0;jenkins-hbase4:40369] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 18:13:04,588 DEBUG [M:0;jenkins-hbase4:40369] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:13:04,588 INFO [M:0;jenkins-hbase4:40369] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.86 KB heapSize=452.09 KB 2023-07-18 18:13:04,635 INFO [M:0;jenkins-hbase4:40369] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.86 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/720f2f2674234c38aca97240377a6cc2 2023-07-18 18:13:04,640 INFO [M:0;jenkins-hbase4:40369] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 720f2f2674234c38aca97240377a6cc2 2023-07-18 18:13:04,641 DEBUG [M:0;jenkins-hbase4:40369] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/720f2f2674234c38aca97240377a6cc2 as hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/720f2f2674234c38aca97240377a6cc2 2023-07-18 18:13:04,646 INFO [M:0;jenkins-hbase4:40369] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 720f2f2674234c38aca97240377a6cc2 2023-07-18 18:13:04,646 INFO [M:0;jenkins-hbase4:40369] regionserver.HStore(1080): Added hdfs://localhost:35301/user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/720f2f2674234c38aca97240377a6cc2, entries=119, sequenceid=899, filesize=28.7 K 2023-07-18 18:13:04,647 INFO [M:0;jenkins-hbase4:40369] regionserver.HRegion(2948): Finished flush of dataSize ~375.86 KB/384878, heapSize ~452.08 KB/462928, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 59ms, sequenceid=899, compaction requested=false 2023-07-18 18:13:04,652 INFO [M:0;jenkins-hbase4:40369] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:13:04,652 DEBUG [M:0;jenkins-hbase4:40369] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:13:04,659 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/764abbda-bbc9-45c2-4e02-6fed6fe5ceb9/MasterData/WALs/jenkins-hbase4.apache.org,40369,1689703815902/jenkins-hbase4.apache.org%2C40369%2C1689703815902.1689703818671 not finished, retry = 0 2023-07-18 18:13:04,682 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:13:04,682 INFO [RS:0;jenkins-hbase4:34171] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34171,1689703817322; zookeeper connection closed. 2023-07-18 18:13:04,682 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): regionserver:34171-0x10179a09a370001, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:13:04,683 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@393e8d9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@393e8d9 2023-07-18 18:13:04,683 INFO [Listener at jenkins-hbase4.apache.org/37995] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-18 18:13:04,760 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:13:04,760 INFO [M:0;jenkins-hbase4:40369] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-18 18:13:04,762 INFO [M:0;jenkins-hbase4:40369] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40369 2023-07-18 18:13:04,764 DEBUG [M:0;jenkins-hbase4:40369] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40369,1689703815902 already deleted, retry=false 2023-07-18 18:13:04,866 INFO [M:0;jenkins-hbase4:40369] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40369,1689703815902; zookeeper connection closed. 2023-07-18 18:13:04,866 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:13:04,866 DEBUG [Listener at localhost/39415-EventThread] zookeeper.ZKWatcher(600): master:40369-0x10179a09a370000, quorum=127.0.0.1:57608, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:13:04,868 WARN [Listener at jenkins-hbase4.apache.org/37995] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:13:04,892 INFO [Listener at jenkins-hbase4.apache.org/37995] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:13:04,997 WARN [BP-379446697-172.31.14.131-1689703811876 heartbeating to localhost/127.0.0.1:35301] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:13:04,997 WARN [BP-379446697-172.31.14.131-1689703811876 heartbeating to localhost/127.0.0.1:35301] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-379446697-172.31.14.131-1689703811876 (Datanode Uuid 69cb99d1-e83a-4e5a-94e8-d85b6528869e) service to localhost/127.0.0.1:35301 2023-07-18 18:13:04,999 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/dfs/data/data5/current/BP-379446697-172.31.14.131-1689703811876] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:13:04,999 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/dfs/data/data6/current/BP-379446697-172.31.14.131-1689703811876] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:13:05,002 WARN [Listener at jenkins-hbase4.apache.org/37995] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:13:05,034 INFO [Listener at jenkins-hbase4.apache.org/37995] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:13:05,138 WARN [BP-379446697-172.31.14.131-1689703811876 heartbeating to localhost/127.0.0.1:35301] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:13:05,138 WARN [BP-379446697-172.31.14.131-1689703811876 heartbeating to localhost/127.0.0.1:35301] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-379446697-172.31.14.131-1689703811876 (Datanode Uuid 6ca67228-b883-4273-88fd-21ed7af7fb89) service to localhost/127.0.0.1:35301 2023-07-18 18:13:05,138 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/dfs/data/data3/current/BP-379446697-172.31.14.131-1689703811876] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:13:05,139 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/dfs/data/data4/current/BP-379446697-172.31.14.131-1689703811876] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:13:05,140 WARN [Listener at jenkins-hbase4.apache.org/37995] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:13:05,142 INFO [Listener at jenkins-hbase4.apache.org/37995] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:13:05,145 WARN [BP-379446697-172.31.14.131-1689703811876 heartbeating to localhost/127.0.0.1:35301] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:13:05,145 WARN [BP-379446697-172.31.14.131-1689703811876 heartbeating to localhost/127.0.0.1:35301] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-379446697-172.31.14.131-1689703811876 (Datanode Uuid a1863efc-37b3-472c-85a1-414a1e1d2fe2) service to localhost/127.0.0.1:35301 2023-07-18 18:13:05,145 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/dfs/data/data1/current/BP-379446697-172.31.14.131-1689703811876] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:13:05,146 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0ee4a880-cadc-0c2c-b434-ef2b3ca3f155/cluster_520bc7db-b0cb-408b-b368-566dbd641b71/dfs/data/data2/current/BP-379446697-172.31.14.131-1689703811876] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:13:05,173 INFO [Listener at jenkins-hbase4.apache.org/37995] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:13:05,326 INFO [Listener at jenkins-hbase4.apache.org/37995] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-18 18:13:05,441 INFO [Listener at jenkins-hbase4.apache.org/37995] hbase.HBaseTestingUtility(1293): Minicluster is down