2023-07-19 13:10:25,042 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-19 13:10:25,352 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f 2023-07-19 13:10:25,353 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-19 13:10:25,353 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-19 13:10:25,405 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 13:10:25,701 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 13:10:25,702 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939, deleteOnExit=true 2023-07-19 13:10:25,702 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 13:10:25,703 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/test.cache.data in system properties and HBase conf 2023-07-19 13:10:25,703 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 13:10:25,704 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop.log.dir in system properties and HBase conf 2023-07-19 13:10:25,704 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 13:10:25,705 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 13:10:25,705 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 13:10:26,078 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 13:10:26,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 13:10:26,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 13:10:26,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 13:10:26,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 13:10:26,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 13:10:26,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 13:10:26,085 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 13:10:26,086 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 13:10:26,086 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 13:10:26,086 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/nfs.dump.dir in system properties and HBase conf 2023-07-19 13:10:26,087 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/java.io.tmpdir in system properties and HBase conf 2023-07-19 13:10:26,087 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 13:10:26,088 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 13:10:26,088 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 13:10:26,690 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 13:10:26,697 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 13:10:27,072 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 13:10:27,312 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 13:10:27,332 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:27,388 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:27,429 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/java.io.tmpdir/Jetty_localhost_44697_hdfs____.8jzsoy/webapp 2023-07-19 13:10:27,595 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44697 2023-07-19 13:10:27,611 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 13:10:27,611 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 13:10:28,277 WARN [Listener at localhost/42143] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 13:10:28,379 WARN [Listener at localhost/42143] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 13:10:28,404 WARN [Listener at localhost/42143] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:28,471 INFO [Listener at localhost/42143] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:28,482 INFO [Listener at localhost/42143] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/java.io.tmpdir/Jetty_localhost_39911_datanode____.g47v6u/webapp 2023-07-19 13:10:28,621 INFO [Listener at localhost/42143] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39911 2023-07-19 13:10:29,125 WARN [Listener at localhost/44361] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 13:10:29,178 WARN [Listener at localhost/44361] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 13:10:29,182 WARN [Listener at localhost/44361] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:29,185 INFO [Listener at localhost/44361] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:29,195 INFO [Listener at localhost/44361] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/java.io.tmpdir/Jetty_localhost_37547_datanode____.b3ehdx/webapp 2023-07-19 13:10:29,338 INFO [Listener at localhost/44361] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37547 2023-07-19 13:10:29,362 WARN [Listener at localhost/45621] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 13:10:29,411 WARN [Listener at localhost/45621] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 13:10:29,415 WARN [Listener at localhost/45621] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:29,417 INFO [Listener at localhost/45621] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:29,434 INFO [Listener at localhost/45621] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/java.io.tmpdir/Jetty_localhost_36255_datanode____.52mp3e/webapp 2023-07-19 13:10:29,671 INFO [Listener at localhost/45621] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36255 2023-07-19 13:10:29,734 WARN [Listener at localhost/34287] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 13:10:30,030 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8e61e0534ac20235: Processing first storage report for DS-b0edbbaa-644a-4d81-be1f-110596f89841 from datanode b732f0fc-5c99-4f95-90f3-186785e06ab8 2023-07-19 13:10:30,032 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8e61e0534ac20235: from storage DS-b0edbbaa-644a-4d81-be1f-110596f89841 node DatanodeRegistration(127.0.0.1:43145, datanodeUuid=b732f0fc-5c99-4f95-90f3-186785e06ab8, infoPort=41347, infoSecurePort=0, ipcPort=34287, storageInfo=lv=-57;cid=testClusterID;nsid=2144509430;c=1689772226788), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-19 13:10:30,032 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed1f01d7b02b570c: Processing first storage report for DS-3c0aad0f-2f84-40d7-a8d2-4036a5cf5b54 from datanode 390a1473-0946-477e-96bd-9ea4b13b6afb 2023-07-19 13:10:30,032 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed1f01d7b02b570c: from storage DS-3c0aad0f-2f84-40d7-a8d2-4036a5cf5b54 node DatanodeRegistration(127.0.0.1:41167, datanodeUuid=390a1473-0946-477e-96bd-9ea4b13b6afb, infoPort=43331, infoSecurePort=0, ipcPort=44361, storageInfo=lv=-57;cid=testClusterID;nsid=2144509430;c=1689772226788), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 13:10:30,032 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3088dde9ecc6608c: Processing first storage report for DS-928fddad-6e53-4fbb-af6e-483b399a34ac from datanode 517078b5-1c6b-4abb-ae9e-9b31cff1524d 2023-07-19 13:10:30,032 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3088dde9ecc6608c: from storage DS-928fddad-6e53-4fbb-af6e-483b399a34ac node DatanodeRegistration(127.0.0.1:32981, datanodeUuid=517078b5-1c6b-4abb-ae9e-9b31cff1524d, infoPort=41531, infoSecurePort=0, ipcPort=45621, storageInfo=lv=-57;cid=testClusterID;nsid=2144509430;c=1689772226788), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 13:10:30,033 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8e61e0534ac20235: Processing first storage report for DS-af872770-0cdd-4d40-a867-583314c6d1ec from datanode b732f0fc-5c99-4f95-90f3-186785e06ab8 2023-07-19 13:10:30,033 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8e61e0534ac20235: from storage DS-af872770-0cdd-4d40-a867-583314c6d1ec node DatanodeRegistration(127.0.0.1:43145, datanodeUuid=b732f0fc-5c99-4f95-90f3-186785e06ab8, infoPort=41347, infoSecurePort=0, ipcPort=34287, storageInfo=lv=-57;cid=testClusterID;nsid=2144509430;c=1689772226788), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 13:10:30,033 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed1f01d7b02b570c: Processing first storage report for DS-38584dd8-c712-47f9-ba15-7d8b3f25c802 from datanode 390a1473-0946-477e-96bd-9ea4b13b6afb 2023-07-19 13:10:30,033 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed1f01d7b02b570c: from storage DS-38584dd8-c712-47f9-ba15-7d8b3f25c802 node DatanodeRegistration(127.0.0.1:41167, datanodeUuid=390a1473-0946-477e-96bd-9ea4b13b6afb, infoPort=43331, infoSecurePort=0, ipcPort=44361, storageInfo=lv=-57;cid=testClusterID;nsid=2144509430;c=1689772226788), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 13:10:30,033 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3088dde9ecc6608c: Processing first storage report for DS-6b0426ba-f7cf-4573-af71-8c9de993230f from datanode 517078b5-1c6b-4abb-ae9e-9b31cff1524d 2023-07-19 13:10:30,034 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3088dde9ecc6608c: from storage DS-6b0426ba-f7cf-4573-af71-8c9de993230f node DatanodeRegistration(127.0.0.1:32981, datanodeUuid=517078b5-1c6b-4abb-ae9e-9b31cff1524d, infoPort=41531, infoSecurePort=0, ipcPort=45621, storageInfo=lv=-57;cid=testClusterID;nsid=2144509430;c=1689772226788), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-19 13:10:30,333 DEBUG [Listener at localhost/34287] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f 2023-07-19 13:10:30,445 INFO [Listener at localhost/34287] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/zookeeper_0, clientPort=64840, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 13:10:30,468 INFO [Listener at localhost/34287] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64840 2023-07-19 13:10:30,481 INFO [Listener at localhost/34287] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:30,483 INFO [Listener at localhost/34287] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:31,209 INFO [Listener at localhost/34287] util.FSUtils(471): Created version file at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 with version=8 2023-07-19 13:10:31,210 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/hbase-staging 2023-07-19 13:10:31,614 INFO [Listener at localhost/34287] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 13:10:32,215 INFO [Listener at localhost/34287] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 13:10:32,252 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,253 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,253 INFO [Listener at localhost/34287] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 13:10:32,253 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,253 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 13:10:32,427 INFO [Listener at localhost/34287] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 13:10:32,511 DEBUG [Listener at localhost/34287] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 13:10:32,624 INFO [Listener at localhost/34287] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33091 2023-07-19 13:10:32,644 INFO [Listener at localhost/34287] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:32,647 INFO [Listener at localhost/34287] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:32,676 INFO [Listener at localhost/34287] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33091 connecting to ZooKeeper ensemble=127.0.0.1:64840 2023-07-19 13:10:32,739 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:330910x0, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 13:10:32,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33091-0x1017db48a130000 connected 2023-07-19 13:10:32,793 DEBUG [Listener at localhost/34287] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 13:10:32,794 DEBUG [Listener at localhost/34287] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:10:32,807 DEBUG [Listener at localhost/34287] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 13:10:32,818 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33091 2023-07-19 13:10:32,818 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33091 2023-07-19 13:10:32,819 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33091 2023-07-19 13:10:32,824 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33091 2023-07-19 13:10:32,825 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33091 2023-07-19 13:10:32,833 INFO [Listener at localhost/34287] master.HMaster(444): hbase.rootdir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5, hbase.cluster.distributed=false 2023-07-19 13:10:32,927 INFO [Listener at localhost/34287] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 13:10:32,927 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,927 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,928 INFO [Listener at localhost/34287] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 13:10:32,928 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,928 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 13:10:32,934 INFO [Listener at localhost/34287] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 13:10:32,938 INFO [Listener at localhost/34287] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41603 2023-07-19 13:10:32,942 INFO [Listener at localhost/34287] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 13:10:32,953 INFO [Listener at localhost/34287] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 13:10:32,954 INFO [Listener at localhost/34287] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:32,957 INFO [Listener at localhost/34287] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:32,959 INFO [Listener at localhost/34287] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41603 connecting to ZooKeeper ensemble=127.0.0.1:64840 2023-07-19 13:10:32,966 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:416030x0, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 13:10:32,970 DEBUG [Listener at localhost/34287] zookeeper.ZKUtil(164): regionserver:416030x0, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 13:10:32,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41603-0x1017db48a130001 connected 2023-07-19 13:10:32,975 DEBUG [Listener at localhost/34287] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:10:32,976 DEBUG [Listener at localhost/34287] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 13:10:32,983 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41603 2023-07-19 13:10:32,983 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41603 2023-07-19 13:10:32,985 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41603 2023-07-19 13:10:33,001 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41603 2023-07-19 13:10:33,002 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41603 2023-07-19 13:10:33,021 INFO [Listener at localhost/34287] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 13:10:33,021 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:33,022 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:33,022 INFO [Listener at localhost/34287] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 13:10:33,023 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:33,023 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 13:10:33,023 INFO [Listener at localhost/34287] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 13:10:33,028 INFO [Listener at localhost/34287] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40427 2023-07-19 13:10:33,028 INFO [Listener at localhost/34287] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 13:10:33,031 INFO [Listener at localhost/34287] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 13:10:33,032 INFO [Listener at localhost/34287] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:33,038 INFO [Listener at localhost/34287] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:33,044 INFO [Listener at localhost/34287] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40427 connecting to ZooKeeper ensemble=127.0.0.1:64840 2023-07-19 13:10:33,056 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:404270x0, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 13:10:33,058 DEBUG [Listener at localhost/34287] zookeeper.ZKUtil(164): regionserver:404270x0, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 13:10:33,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40427-0x1017db48a130002 connected 2023-07-19 13:10:33,059 DEBUG [Listener at localhost/34287] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:10:33,066 DEBUG [Listener at localhost/34287] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 13:10:33,070 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40427 2023-07-19 13:10:33,078 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40427 2023-07-19 13:10:33,083 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40427 2023-07-19 13:10:33,086 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40427 2023-07-19 13:10:33,087 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40427 2023-07-19 13:10:33,100 INFO [Listener at localhost/34287] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 13:10:33,101 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:33,101 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:33,101 INFO [Listener at localhost/34287] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 13:10:33,101 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:33,101 INFO [Listener at localhost/34287] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 13:10:33,101 INFO [Listener at localhost/34287] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 13:10:33,103 INFO [Listener at localhost/34287] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40947 2023-07-19 13:10:33,103 INFO [Listener at localhost/34287] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 13:10:33,106 INFO [Listener at localhost/34287] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 13:10:33,107 INFO [Listener at localhost/34287] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:33,109 INFO [Listener at localhost/34287] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:33,111 INFO [Listener at localhost/34287] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40947 connecting to ZooKeeper ensemble=127.0.0.1:64840 2023-07-19 13:10:33,122 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:409470x0, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 13:10:33,124 DEBUG [Listener at localhost/34287] zookeeper.ZKUtil(164): regionserver:409470x0, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 13:10:33,124 DEBUG [Listener at localhost/34287] zookeeper.ZKUtil(164): regionserver:409470x0, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:10:33,125 DEBUG [Listener at localhost/34287] zookeeper.ZKUtil(164): regionserver:409470x0, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 13:10:33,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40947-0x1017db48a130003 connected 2023-07-19 13:10:33,130 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40947 2023-07-19 13:10:33,130 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40947 2023-07-19 13:10:33,135 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40947 2023-07-19 13:10:33,139 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40947 2023-07-19 13:10:33,141 DEBUG [Listener at localhost/34287] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40947 2023-07-19 13:10:33,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33091,1689772231406 2023-07-19 13:10:33,156 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 13:10:33,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33091,1689772231406 2023-07-19 13:10:33,179 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 13:10:33,179 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 13:10:33,179 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 13:10:33,179 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 13:10:33,180 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:33,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 13:10:33,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33091,1689772231406 from backup master directory 2023-07-19 13:10:33,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 13:10:33,188 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33091,1689772231406 2023-07-19 13:10:33,188 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 13:10:33,189 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 13:10:33,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33091,1689772231406 2023-07-19 13:10:33,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 13:10:33,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 13:10:33,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/hbase.id with ID: 39ba5c72-c373-409a-b9c7-67fcf7de4ae9 2023-07-19 13:10:33,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:33,389 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:33,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2d9c77e7 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:33,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f2b66a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:33,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 13:10:33,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 13:10:33,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 13:10:33,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 13:10:33,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 13:10:33,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 13:10:33,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 13:10:33,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/data/master/store-tmp 2023-07-19 13:10:33,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:33,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 13:10:33,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:10:33,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:10:33,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 13:10:33,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:10:33,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:10:33,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 13:10:33,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/WALs/jenkins-hbase4.apache.org,33091,1689772231406 2023-07-19 13:10:33,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33091%2C1689772231406, suffix=, logDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/WALs/jenkins-hbase4.apache.org,33091,1689772231406, archiveDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/oldWALs, maxLogs=10 2023-07-19 13:10:33,806 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32981,DS-928fddad-6e53-4fbb-af6e-483b399a34ac,DISK] 2023-07-19 13:10:33,806 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43145,DS-b0edbbaa-644a-4d81-be1f-110596f89841,DISK] 2023-07-19 13:10:33,806 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41167,DS-3c0aad0f-2f84-40d7-a8d2-4036a5cf5b54,DISK] 2023-07-19 13:10:33,815 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 13:10:33,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/WALs/jenkins-hbase4.apache.org,33091,1689772231406/jenkins-hbase4.apache.org%2C33091%2C1689772231406.1689772233719 2023-07-19 13:10:33,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32981,DS-928fddad-6e53-4fbb-af6e-483b399a34ac,DISK], DatanodeInfoWithStorage[127.0.0.1:41167,DS-3c0aad0f-2f84-40d7-a8d2-4036a5cf5b54,DISK], DatanodeInfoWithStorage[127.0.0.1:43145,DS-b0edbbaa-644a-4d81-be1f-110596f89841,DISK]] 2023-07-19 13:10:33,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 13:10:33,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:33,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 13:10:33,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 13:10:33,994 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 13:10:34,002 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 13:10:34,036 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 13:10:34,051 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:34,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 13:10:34,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 13:10:34,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 13:10:34,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:10:34,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65409946, jitterRate=-0.025315850973129272}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:10:34,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 13:10:34,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 13:10:34,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 13:10:34,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 13:10:34,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 13:10:34,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-19 13:10:34,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 39 msec 2023-07-19 13:10:34,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 13:10:34,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 13:10:34,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 13:10:34,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 13:10:34,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 13:10:34,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 13:10:34,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 13:10:34,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 13:10:34,281 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:34,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 13:10:34,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 13:10:34,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 13:10:34,317 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 13:10:34,317 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 13:10:34,317 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 13:10:34,317 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:34,317 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 13:10:34,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33091,1689772231406, sessionid=0x1017db48a130000, setting cluster-up flag (Was=false) 2023-07-19 13:10:34,345 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:34,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 13:10:34,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33091,1689772231406 2023-07-19 13:10:34,360 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:34,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 13:10:34,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33091,1689772231406 2023-07-19 13:10:34,370 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp 2023-07-19 13:10:34,449 INFO [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(951): ClusterId : 39ba5c72-c373-409a-b9c7-67fcf7de4ae9 2023-07-19 13:10:34,449 INFO [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(951): ClusterId : 39ba5c72-c373-409a-b9c7-67fcf7de4ae9 2023-07-19 13:10:34,455 INFO [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer(951): ClusterId : 39ba5c72-c373-409a-b9c7-67fcf7de4ae9 2023-07-19 13:10:34,468 DEBUG [RS:1;jenkins-hbase4:40427] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 13:10:34,468 DEBUG [RS:2;jenkins-hbase4:40947] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 13:10:34,468 DEBUG [RS:0;jenkins-hbase4:41603] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 13:10:34,489 DEBUG [RS:0;jenkins-hbase4:41603] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 13:10:34,490 DEBUG [RS:1;jenkins-hbase4:40427] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 13:10:34,490 DEBUG [RS:1;jenkins-hbase4:40427] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 13:10:34,490 DEBUG [RS:0;jenkins-hbase4:41603] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 13:10:34,491 DEBUG [RS:2;jenkins-hbase4:40947] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 13:10:34,493 DEBUG [RS:2;jenkins-hbase4:40947] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 13:10:34,497 DEBUG [RS:0;jenkins-hbase4:41603] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 13:10:34,497 DEBUG [RS:2;jenkins-hbase4:40947] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 13:10:34,497 DEBUG [RS:1;jenkins-hbase4:40427] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 13:10:34,500 DEBUG [RS:2;jenkins-hbase4:40947] zookeeper.ReadOnlyZKClient(139): Connect 0x5c837e85 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:34,500 DEBUG [RS:0;jenkins-hbase4:41603] zookeeper.ReadOnlyZKClient(139): Connect 0x4fe1d641 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:34,509 DEBUG [RS:1;jenkins-hbase4:40427] zookeeper.ReadOnlyZKClient(139): Connect 0x5366c819 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:34,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 13:10:34,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:34,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 13:10:34,551 DEBUG [RS:2;jenkins-hbase4:40947] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52448b65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:34,552 DEBUG [RS:2;jenkins-hbase4:40947] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@567b15f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 13:10:34,591 DEBUG [RS:1;jenkins-hbase4:40427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5da13c05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:34,591 DEBUG [RS:0;jenkins-hbase4:41603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@412631cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:34,592 DEBUG [RS:1;jenkins-hbase4:40427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@599ea369, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 13:10:34,593 DEBUG [RS:0;jenkins-hbase4:41603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b3bf6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 13:10:34,614 DEBUG [RS:1;jenkins-hbase4:40427] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40427 2023-07-19 13:10:34,615 DEBUG [RS:2;jenkins-hbase4:40947] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40947 2023-07-19 13:10:34,617 DEBUG [RS:0;jenkins-hbase4:41603] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41603 2023-07-19 13:10:34,622 INFO [RS:1;jenkins-hbase4:40427] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 13:10:34,623 INFO [RS:2;jenkins-hbase4:40947] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 13:10:34,623 INFO [RS:1;jenkins-hbase4:40427] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 13:10:34,622 INFO [RS:0;jenkins-hbase4:41603] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 13:10:34,623 INFO [RS:2;jenkins-hbase4:40947] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 13:10:34,623 INFO [RS:0;jenkins-hbase4:41603] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 13:10:34,623 DEBUG [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 13:10:34,624 DEBUG [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 13:10:34,623 DEBUG [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 13:10:34,627 INFO [RS:2;jenkins-hbase4:40947] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:34,627 INFO [RS:0;jenkins-hbase4:41603] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:34,628 DEBUG [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 13:10:34,628 DEBUG [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 13:10:34,631 INFO [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33091,1689772231406 with isa=jenkins-hbase4.apache.org/172.31.14.131:40947, startcode=1689772233100 2023-07-19 13:10:34,631 INFO [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33091,1689772231406 with isa=jenkins-hbase4.apache.org/172.31.14.131:41603, startcode=1689772232926 2023-07-19 13:10:34,632 INFO [RS:1;jenkins-hbase4:40427] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:34,632 DEBUG [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 13:10:34,634 INFO [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33091,1689772231406 with isa=jenkins-hbase4.apache.org/172.31.14.131:40427, startcode=1689772233020 2023-07-19 13:10:34,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 13:10:34,654 DEBUG [RS:2;jenkins-hbase4:40947] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 13:10:34,654 DEBUG [RS:1;jenkins-hbase4:40427] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 13:10:34,654 DEBUG [RS:0;jenkins-hbase4:41603] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 13:10:34,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 13:10:34,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 13:10:34,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 13:10:34,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 13:10:34,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 13:10:34,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 13:10:34,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689772264683 2023-07-19 13:10:34,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 13:10:34,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 13:10:34,712 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 13:10:34,714 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 13:10:34,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 13:10:34,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 13:10:34,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 13:10:34,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 13:10:34,721 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 13:10:34,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 13:10:34,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 13:10:34,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 13:10:34,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 13:10:34,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 13:10:34,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689772234742,5,FailOnTimeoutGroup] 2023-07-19 13:10:34,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689772234755,5,FailOnTimeoutGroup] 2023-07-19 13:10:34,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 13:10:34,765 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35293, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 13:10:34,765 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54377, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 13:10:34,765 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55281, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 13:10:34,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,791 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:34,812 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:34,812 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33091] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:34,827 DEBUG [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:10:34,827 DEBUG [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42143 2023-07-19 13:10:34,827 DEBUG [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 13:10:34,831 DEBUG [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:10:34,831 DEBUG [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42143 2023-07-19 13:10:34,831 DEBUG [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 13:10:34,832 DEBUG [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:10:34,832 DEBUG [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42143 2023-07-19 13:10:34,832 DEBUG [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 13:10:34,837 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:10:34,838 DEBUG [RS:2;jenkins-hbase4:40947] zookeeper.ZKUtil(162): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:34,839 WARN [RS:2;jenkins-hbase4:40947] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 13:10:34,839 INFO [RS:2;jenkins-hbase4:40947] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 13:10:34,839 DEBUG [RS:1;jenkins-hbase4:40427] zookeeper.ZKUtil(162): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:34,839 DEBUG [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/WALs/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:34,839 DEBUG [RS:0;jenkins-hbase4:41603] zookeeper.ZKUtil(162): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:34,839 WARN [RS:1;jenkins-hbase4:40427] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 13:10:34,839 WARN [RS:0;jenkins-hbase4:41603] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 13:10:34,852 INFO [RS:1;jenkins-hbase4:40427] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 13:10:34,856 DEBUG [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/WALs/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:34,857 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40427,1689772233020] 2023-07-19 13:10:34,857 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40947,1689772233100] 2023-07-19 13:10:34,857 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41603,1689772232926] 2023-07-19 13:10:34,852 INFO [RS:0;jenkins-hbase4:41603] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 13:10:34,864 DEBUG [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/WALs/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:34,905 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 13:10:34,906 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 13:10:34,906 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:10:34,909 DEBUG [RS:2;jenkins-hbase4:40947] zookeeper.ZKUtil(162): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:34,909 DEBUG [RS:1;jenkins-hbase4:40427] zookeeper.ZKUtil(162): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:34,911 DEBUG [RS:1;jenkins-hbase4:40427] zookeeper.ZKUtil(162): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:34,911 DEBUG [RS:0;jenkins-hbase4:41603] zookeeper.ZKUtil(162): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:34,912 DEBUG [RS:2;jenkins-hbase4:40947] zookeeper.ZKUtil(162): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:34,912 DEBUG [RS:1;jenkins-hbase4:40427] zookeeper.ZKUtil(162): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:34,912 DEBUG [RS:2;jenkins-hbase4:40947] zookeeper.ZKUtil(162): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:34,912 DEBUG [RS:0;jenkins-hbase4:41603] zookeeper.ZKUtil(162): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:34,913 DEBUG [RS:0;jenkins-hbase4:41603] zookeeper.ZKUtil(162): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:34,939 DEBUG [RS:2;jenkins-hbase4:40947] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 13:10:34,939 DEBUG [RS:0;jenkins-hbase4:41603] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 13:10:34,939 DEBUG [RS:1;jenkins-hbase4:40427] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 13:10:34,946 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:34,951 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 13:10:34,953 INFO [RS:2;jenkins-hbase4:40947] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 13:10:34,953 INFO [RS:1;jenkins-hbase4:40427] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 13:10:34,954 INFO [RS:0;jenkins-hbase4:41603] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 13:10:34,955 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/info 2023-07-19 13:10:34,958 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 13:10:34,959 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:34,959 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 13:10:34,963 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/rep_barrier 2023-07-19 13:10:34,964 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 13:10:34,964 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:34,965 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 13:10:34,967 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/table 2023-07-19 13:10:34,968 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 13:10:34,984 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:34,997 INFO [RS:2;jenkins-hbase4:40947] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 13:10:35,007 INFO [RS:0;jenkins-hbase4:41603] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 13:10:35,011 INFO [RS:1;jenkins-hbase4:40427] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 13:10:35,012 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740 2023-07-19 13:10:35,013 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740 2023-07-19 13:10:35,023 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 13:10:35,024 INFO [RS:0;jenkins-hbase4:41603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 13:10:35,025 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 13:10:35,024 INFO [RS:0;jenkins-hbase4:41603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,028 INFO [RS:1;jenkins-hbase4:40427] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 13:10:35,030 INFO [RS:1;jenkins-hbase4:40427] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,031 INFO [RS:2;jenkins-hbase4:40947] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 13:10:35,031 INFO [RS:2;jenkins-hbase4:40947] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,031 INFO [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 13:10:35,032 INFO [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 13:10:35,032 INFO [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 13:10:35,039 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:10:35,043 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68144207, jitterRate=0.015427812933921814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 13:10:35,043 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 13:10:35,043 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 13:10:35,043 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 13:10:35,043 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 13:10:35,043 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 13:10:35,044 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 13:10:35,045 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 13:10:35,045 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 13:10:35,049 INFO [RS:1;jenkins-hbase4:40427] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,049 INFO [RS:2;jenkins-hbase4:40947] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,049 DEBUG [RS:1;jenkins-hbase4:40427] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,049 DEBUG [RS:1;jenkins-hbase4:40427] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,049 DEBUG [RS:1;jenkins-hbase4:40427] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,050 DEBUG [RS:1;jenkins-hbase4:40427] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,050 DEBUG [RS:1;jenkins-hbase4:40427] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,050 DEBUG [RS:1;jenkins-hbase4:40427] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 13:10:35,050 DEBUG [RS:1;jenkins-hbase4:40427] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,050 DEBUG [RS:1;jenkins-hbase4:40427] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,050 DEBUG [RS:1;jenkins-hbase4:40427] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,050 DEBUG [RS:1;jenkins-hbase4:40427] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,051 INFO [RS:0;jenkins-hbase4:41603] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,055 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 13:10:35,055 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 13:10:35,049 DEBUG [RS:2;jenkins-hbase4:40947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,058 DEBUG [RS:0;jenkins-hbase4:41603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,058 DEBUG [RS:2;jenkins-hbase4:40947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,058 DEBUG [RS:0;jenkins-hbase4:41603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,059 DEBUG [RS:2;jenkins-hbase4:40947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,059 DEBUG [RS:0;jenkins-hbase4:41603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,059 DEBUG [RS:2;jenkins-hbase4:40947] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,059 DEBUG [RS:0;jenkins-hbase4:41603] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,059 DEBUG [RS:2;jenkins-hbase4:40947] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,059 DEBUG [RS:0;jenkins-hbase4:41603] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,059 DEBUG [RS:2;jenkins-hbase4:40947] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 13:10:35,059 DEBUG [RS:0;jenkins-hbase4:41603] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 13:10:35,059 DEBUG [RS:2;jenkins-hbase4:40947] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,059 DEBUG [RS:0;jenkins-hbase4:41603] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,059 DEBUG [RS:2;jenkins-hbase4:40947] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,059 DEBUG [RS:0;jenkins-hbase4:41603] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,059 DEBUG [RS:2;jenkins-hbase4:40947] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,059 DEBUG [RS:0;jenkins-hbase4:41603] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,060 DEBUG [RS:2;jenkins-hbase4:40947] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,060 DEBUG [RS:0;jenkins-hbase4:41603] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:35,063 INFO [RS:1;jenkins-hbase4:40427] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,063 INFO [RS:1;jenkins-hbase4:40427] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,069 INFO [RS:1;jenkins-hbase4:40427] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,074 INFO [RS:2;jenkins-hbase4:40947] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,074 INFO [RS:2;jenkins-hbase4:40947] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,074 INFO [RS:2;jenkins-hbase4:40947] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 13:10:35,084 INFO [RS:0;jenkins-hbase4:41603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,084 INFO [RS:0;jenkins-hbase4:41603] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,084 INFO [RS:0;jenkins-hbase4:41603] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,101 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 13:10:35,105 INFO [RS:1;jenkins-hbase4:40427] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 13:10:35,109 INFO [RS:1;jenkins-hbase4:40427] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40427,1689772233020-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,118 INFO [RS:0;jenkins-hbase4:41603] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 13:10:35,122 INFO [RS:2;jenkins-hbase4:40947] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 13:10:35,123 INFO [RS:2;jenkins-hbase4:40947] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40947,1689772233100-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,123 INFO [RS:0;jenkins-hbase4:41603] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41603,1689772232926-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,145 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 13:10:35,151 INFO [RS:2;jenkins-hbase4:40947] regionserver.Replication(203): jenkins-hbase4.apache.org,40947,1689772233100 started 2023-07-19 13:10:35,152 INFO [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40947,1689772233100, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40947, sessionid=0x1017db48a130003 2023-07-19 13:10:35,152 DEBUG [RS:2;jenkins-hbase4:40947] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 13:10:35,152 DEBUG [RS:2;jenkins-hbase4:40947] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:35,152 DEBUG [RS:2;jenkins-hbase4:40947] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40947,1689772233100' 2023-07-19 13:10:35,152 DEBUG [RS:2;jenkins-hbase4:40947] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 13:10:35,153 DEBUG [RS:2;jenkins-hbase4:40947] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 13:10:35,155 DEBUG [RS:2;jenkins-hbase4:40947] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 13:10:35,156 DEBUG [RS:2;jenkins-hbase4:40947] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 13:10:35,156 DEBUG [RS:2;jenkins-hbase4:40947] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:35,156 DEBUG [RS:2;jenkins-hbase4:40947] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40947,1689772233100' 2023-07-19 13:10:35,156 DEBUG [RS:2;jenkins-hbase4:40947] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:35,157 DEBUG [RS:2;jenkins-hbase4:40947] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:35,159 DEBUG [RS:2;jenkins-hbase4:40947] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 13:10:35,159 INFO [RS:2;jenkins-hbase4:40947] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 13:10:35,159 INFO [RS:2;jenkins-hbase4:40947] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 13:10:35,166 INFO [RS:1;jenkins-hbase4:40427] regionserver.Replication(203): jenkins-hbase4.apache.org,40427,1689772233020 started 2023-07-19 13:10:35,166 INFO [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40427,1689772233020, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40427, sessionid=0x1017db48a130002 2023-07-19 13:10:35,166 DEBUG [RS:1;jenkins-hbase4:40427] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 13:10:35,167 DEBUG [RS:1;jenkins-hbase4:40427] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:35,167 DEBUG [RS:1;jenkins-hbase4:40427] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40427,1689772233020' 2023-07-19 13:10:35,168 DEBUG [RS:1;jenkins-hbase4:40427] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 13:10:35,168 DEBUG [RS:1;jenkins-hbase4:40427] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 13:10:35,169 DEBUG [RS:1;jenkins-hbase4:40427] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 13:10:35,169 DEBUG [RS:1;jenkins-hbase4:40427] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 13:10:35,169 DEBUG [RS:1;jenkins-hbase4:40427] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:35,170 DEBUG [RS:1;jenkins-hbase4:40427] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40427,1689772233020' 2023-07-19 13:10:35,170 DEBUG [RS:1;jenkins-hbase4:40427] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:35,171 DEBUG [RS:1;jenkins-hbase4:40427] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:35,171 DEBUG [RS:1;jenkins-hbase4:40427] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 13:10:35,172 INFO [RS:1;jenkins-hbase4:40427] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 13:10:35,191 INFO [RS:0;jenkins-hbase4:41603] regionserver.Replication(203): jenkins-hbase4.apache.org,41603,1689772232926 started 2023-07-19 13:10:35,192 INFO [RS:1;jenkins-hbase4:40427] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 13:10:35,192 INFO [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41603,1689772232926, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41603, sessionid=0x1017db48a130001 2023-07-19 13:10:35,193 DEBUG [RS:0;jenkins-hbase4:41603] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 13:10:35,193 DEBUG [RS:0;jenkins-hbase4:41603] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:35,193 DEBUG [RS:0;jenkins-hbase4:41603] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41603,1689772232926' 2023-07-19 13:10:35,193 DEBUG [RS:0;jenkins-hbase4:41603] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 13:10:35,195 DEBUG [RS:0;jenkins-hbase4:41603] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 13:10:35,195 DEBUG [RS:0;jenkins-hbase4:41603] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 13:10:35,195 DEBUG [RS:0;jenkins-hbase4:41603] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 13:10:35,195 DEBUG [RS:0;jenkins-hbase4:41603] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:35,195 DEBUG [RS:0;jenkins-hbase4:41603] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41603,1689772232926' 2023-07-19 13:10:35,195 DEBUG [RS:0;jenkins-hbase4:41603] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:35,196 DEBUG [RS:0;jenkins-hbase4:41603] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:35,196 DEBUG [RS:0;jenkins-hbase4:41603] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 13:10:35,197 INFO [RS:0;jenkins-hbase4:41603] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 13:10:35,197 INFO [RS:0;jenkins-hbase4:41603] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 13:10:35,271 INFO [RS:2;jenkins-hbase4:40947] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40947%2C1689772233100, suffix=, logDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/WALs/jenkins-hbase4.apache.org,40947,1689772233100, archiveDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/oldWALs, maxLogs=32 2023-07-19 13:10:35,296 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32981,DS-928fddad-6e53-4fbb-af6e-483b399a34ac,DISK] 2023-07-19 13:10:35,298 DEBUG [jenkins-hbase4:33091] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-19 13:10:35,302 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43145,DS-b0edbbaa-644a-4d81-be1f-110596f89841,DISK] 2023-07-19 13:10:35,300 INFO [RS:0;jenkins-hbase4:41603] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41603%2C1689772232926, suffix=, logDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/WALs/jenkins-hbase4.apache.org,41603,1689772232926, archiveDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/oldWALs, maxLogs=32 2023-07-19 13:10:35,298 INFO [RS:1;jenkins-hbase4:40427] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40427%2C1689772233020, suffix=, logDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/WALs/jenkins-hbase4.apache.org,40427,1689772233020, archiveDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/oldWALs, maxLogs=32 2023-07-19 13:10:35,307 DEBUG [jenkins-hbase4:33091] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:10:35,307 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41167,DS-3c0aad0f-2f84-40d7-a8d2-4036a5cf5b54,DISK] 2023-07-19 13:10:35,318 DEBUG [jenkins-hbase4:33091] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:10:35,319 DEBUG [jenkins-hbase4:33091] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:10:35,319 DEBUG [jenkins-hbase4:33091] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:10:35,319 INFO [RS:2;jenkins-hbase4:40947] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/WALs/jenkins-hbase4.apache.org,40947,1689772233100/jenkins-hbase4.apache.org%2C40947%2C1689772233100.1689772235274 2023-07-19 13:10:35,319 DEBUG [jenkins-hbase4:33091] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:10:35,326 DEBUG [RS:2;jenkins-hbase4:40947] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43145,DS-b0edbbaa-644a-4d81-be1f-110596f89841,DISK], DatanodeInfoWithStorage[127.0.0.1:32981,DS-928fddad-6e53-4fbb-af6e-483b399a34ac,DISK], DatanodeInfoWithStorage[127.0.0.1:41167,DS-3c0aad0f-2f84-40d7-a8d2-4036a5cf5b54,DISK]] 2023-07-19 13:10:35,334 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40427,1689772233020, state=OPENING 2023-07-19 13:10:35,353 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 13:10:35,357 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:35,359 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 13:10:35,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:10:35,403 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43145,DS-b0edbbaa-644a-4d81-be1f-110596f89841,DISK] 2023-07-19 13:10:35,403 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41167,DS-3c0aad0f-2f84-40d7-a8d2-4036a5cf5b54,DISK] 2023-07-19 13:10:35,405 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32981,DS-928fddad-6e53-4fbb-af6e-483b399a34ac,DISK] 2023-07-19 13:10:35,408 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43145,DS-b0edbbaa-644a-4d81-be1f-110596f89841,DISK] 2023-07-19 13:10:35,408 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32981,DS-928fddad-6e53-4fbb-af6e-483b399a34ac,DISK] 2023-07-19 13:10:35,408 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41167,DS-3c0aad0f-2f84-40d7-a8d2-4036a5cf5b54,DISK] 2023-07-19 13:10:35,422 INFO [RS:1;jenkins-hbase4:40427] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/WALs/jenkins-hbase4.apache.org,40427,1689772233020/jenkins-hbase4.apache.org%2C40427%2C1689772233020.1689772235309 2023-07-19 13:10:35,431 DEBUG [RS:1;jenkins-hbase4:40427] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32981,DS-928fddad-6e53-4fbb-af6e-483b399a34ac,DISK], DatanodeInfoWithStorage[127.0.0.1:43145,DS-b0edbbaa-644a-4d81-be1f-110596f89841,DISK], DatanodeInfoWithStorage[127.0.0.1:41167,DS-3c0aad0f-2f84-40d7-a8d2-4036a5cf5b54,DISK]] 2023-07-19 13:10:35,437 INFO [RS:0;jenkins-hbase4:41603] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/WALs/jenkins-hbase4.apache.org,41603,1689772232926/jenkins-hbase4.apache.org%2C41603%2C1689772232926.1689772235309 2023-07-19 13:10:35,439 DEBUG [RS:0;jenkins-hbase4:41603] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32981,DS-928fddad-6e53-4fbb-af6e-483b399a34ac,DISK], DatanodeInfoWithStorage[127.0.0.1:43145,DS-b0edbbaa-644a-4d81-be1f-110596f89841,DISK], DatanodeInfoWithStorage[127.0.0.1:41167,DS-3c0aad0f-2f84-40d7-a8d2-4036a5cf5b54,DISK]] 2023-07-19 13:10:35,624 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:35,627 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 13:10:35,634 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 13:10:35,655 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 13:10:35,655 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 13:10:35,659 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40427%2C1689772233020.meta, suffix=.meta, logDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/WALs/jenkins-hbase4.apache.org,40427,1689772233020, archiveDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/oldWALs, maxLogs=32 2023-07-19 13:10:35,683 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41167,DS-3c0aad0f-2f84-40d7-a8d2-4036a5cf5b54,DISK] 2023-07-19 13:10:35,684 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32981,DS-928fddad-6e53-4fbb-af6e-483b399a34ac,DISK] 2023-07-19 13:10:35,686 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43145,DS-b0edbbaa-644a-4d81-be1f-110596f89841,DISK] 2023-07-19 13:10:35,713 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/WALs/jenkins-hbase4.apache.org,40427,1689772233020/jenkins-hbase4.apache.org%2C40427%2C1689772233020.meta.1689772235661.meta 2023-07-19 13:10:35,719 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41167,DS-3c0aad0f-2f84-40d7-a8d2-4036a5cf5b54,DISK], DatanodeInfoWithStorage[127.0.0.1:32981,DS-928fddad-6e53-4fbb-af6e-483b399a34ac,DISK], DatanodeInfoWithStorage[127.0.0.1:43145,DS-b0edbbaa-644a-4d81-be1f-110596f89841,DISK]] 2023-07-19 13:10:35,719 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 13:10:35,721 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 13:10:35,723 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:35,724 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 13:10:35,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 13:10:35,729 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 13:10:35,749 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 13:10:35,750 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:35,750 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 13:10:35,750 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 13:10:35,759 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 13:10:35,761 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/info 2023-07-19 13:10:35,762 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/info 2023-07-19 13:10:35,763 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 13:10:35,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:35,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 13:10:35,766 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/rep_barrier 2023-07-19 13:10:35,766 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/rep_barrier 2023-07-19 13:10:35,770 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 13:10:35,771 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:35,771 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 13:10:35,773 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/table 2023-07-19 13:10:35,773 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/table 2023-07-19 13:10:35,773 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 13:10:35,775 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:35,777 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740 2023-07-19 13:10:35,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740 2023-07-19 13:10:35,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 13:10:35,788 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 13:10:35,790 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72931516, jitterRate=0.08676427602767944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 13:10:35,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 13:10:35,806 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689772235612 2023-07-19 13:10:35,832 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 13:10:35,834 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 13:10:35,834 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40427,1689772233020, state=OPEN 2023-07-19 13:10:35,839 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 13:10:35,839 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 13:10:35,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 13:10:35,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40427,1689772233020 in 475 msec 2023-07-19 13:10:35,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 13:10:35,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 772 msec 2023-07-19 13:10:35,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3120 sec 2023-07-19 13:10:35,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689772235876, completionTime=-1 2023-07-19 13:10:35,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-19 13:10:35,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 13:10:35,970 DEBUG [hconnection-0x1b9cf62d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:35,975 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:36,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-19 13:10:36,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689772296006 2023-07-19 13:10:36,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689772356006 2023-07-19 13:10:36,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 130 msec 2023-07-19 13:10:36,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33091,1689772231406-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:36,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33091,1689772231406-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:36,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33091,1689772231406-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:36,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33091, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:36,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:36,050 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 13:10:36,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 13:10:36,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 13:10:36,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 13:10:36,083 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:10:36,086 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:10:36,116 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11 2023-07-19 13:10:36,120 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11 empty. 2023-07-19 13:10:36,121 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11 2023-07-19 13:10:36,121 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 13:10:36,173 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 13:10:36,179 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8c0c372c89d9dea857cad4b5ddd06c11, NAME => 'hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:10:36,210 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:36,210 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 8c0c372c89d9dea857cad4b5ddd06c11, disabling compactions & flushes 2023-07-19 13:10:36,210 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. 2023-07-19 13:10:36,210 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. 2023-07-19 13:10:36,210 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. after waiting 0 ms 2023-07-19 13:10:36,210 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. 2023-07-19 13:10:36,210 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. 2023-07-19 13:10:36,210 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 8c0c372c89d9dea857cad4b5ddd06c11: 2023-07-19 13:10:36,219 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:10:36,236 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689772236223"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772236223"}]},"ts":"1689772236223"} 2023-07-19 13:10:36,271 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 13:10:36,274 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:10:36,279 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772236274"}]},"ts":"1689772236274"} 2023-07-19 13:10:36,283 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 13:10:36,288 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:10:36,289 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:10:36,289 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:10:36,289 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:10:36,289 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:10:36,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8c0c372c89d9dea857cad4b5ddd06c11, ASSIGN}] 2023-07-19 13:10:36,296 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8c0c372c89d9dea857cad4b5ddd06c11, ASSIGN 2023-07-19 13:10:36,298 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8c0c372c89d9dea857cad4b5ddd06c11, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40947,1689772233100; forceNewPlan=false, retain=false 2023-07-19 13:10:36,450 INFO [jenkins-hbase4:33091] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 13:10:36,452 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8c0c372c89d9dea857cad4b5ddd06c11, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:36,452 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689772236451"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772236451"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772236451"}]},"ts":"1689772236451"} 2023-07-19 13:10:36,456 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8c0c372c89d9dea857cad4b5ddd06c11, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:10:36,613 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:36,614 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 13:10:36,617 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 13:10:36,628 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. 2023-07-19 13:10:36,628 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c0c372c89d9dea857cad4b5ddd06c11, NAME => 'hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11.', STARTKEY => '', ENDKEY => ''} 2023-07-19 13:10:36,628 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. service=AccessControlService 2023-07-19 13:10:36,629 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:36,630 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8c0c372c89d9dea857cad4b5ddd06c11 2023-07-19 13:10:36,630 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:36,630 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8c0c372c89d9dea857cad4b5ddd06c11 2023-07-19 13:10:36,630 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8c0c372c89d9dea857cad4b5ddd06c11 2023-07-19 13:10:36,634 INFO [StoreOpener-8c0c372c89d9dea857cad4b5ddd06c11-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8c0c372c89d9dea857cad4b5ddd06c11 2023-07-19 13:10:36,638 DEBUG [StoreOpener-8c0c372c89d9dea857cad4b5ddd06c11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11/info 2023-07-19 13:10:36,638 DEBUG [StoreOpener-8c0c372c89d9dea857cad4b5ddd06c11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11/info 2023-07-19 13:10:36,638 INFO [StoreOpener-8c0c372c89d9dea857cad4b5ddd06c11-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c0c372c89d9dea857cad4b5ddd06c11 columnFamilyName info 2023-07-19 13:10:36,640 INFO [StoreOpener-8c0c372c89d9dea857cad4b5ddd06c11-1] regionserver.HStore(310): Store=8c0c372c89d9dea857cad4b5ddd06c11/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:36,642 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11 2023-07-19 13:10:36,643 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11 2023-07-19 13:10:36,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8c0c372c89d9dea857cad4b5ddd06c11 2023-07-19 13:10:36,665 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:10:36,666 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8c0c372c89d9dea857cad4b5ddd06c11; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64657056, jitterRate=-0.036534786224365234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:10:36,666 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8c0c372c89d9dea857cad4b5ddd06c11: 2023-07-19 13:10:36,668 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11., pid=6, masterSystemTime=1689772236613 2023-07-19 13:10:36,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. 2023-07-19 13:10:36,676 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. 2023-07-19 13:10:36,680 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8c0c372c89d9dea857cad4b5ddd06c11, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:36,680 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689772236679"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772236679"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772236679"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772236679"}]},"ts":"1689772236679"} 2023-07-19 13:10:36,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 13:10:36,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8c0c372c89d9dea857cad4b5ddd06c11, server=jenkins-hbase4.apache.org,40947,1689772233100 in 227 msec 2023-07-19 13:10:36,692 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 13:10:36,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8c0c372c89d9dea857cad4b5ddd06c11, ASSIGN in 396 msec 2023-07-19 13:10:36,694 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:10:36,694 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772236694"}]},"ts":"1689772236694"} 2023-07-19 13:10:36,697 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 13:10:36,700 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:10:36,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 632 msec 2023-07-19 13:10:36,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 13:10:36,785 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 13:10:36,785 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:36,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:36,810 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:36,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 13:10:36,843 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 13:10:36,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-07-19 13:10:36,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 13:10:36,868 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 13:10:36,874 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-19 13:10:36,884 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 13:10:36,886 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 13:10:36,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.697sec 2023-07-19 13:10:36,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-19 13:10:36,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 13:10:36,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 13:10:36,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33091,1689772231406-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 13:10:36,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33091,1689772231406-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 13:10:36,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 13:10:36,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 13:10:36,917 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:10:36,919 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:10:36,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-19 13:10:36,922 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877 2023-07-19 13:10:36,923 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877 empty. 2023-07-19 13:10:36,926 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877 2023-07-19 13:10:36,926 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 13:10:36,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 13:10:36,964 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 13:10:36,964 DEBUG [Listener at localhost/34287] zookeeper.ReadOnlyZKClient(139): Connect 0x783bbc0f to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:36,968 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5b7aa3312a3928563d14ec9b4ef3877, NAME => 'hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:10:36,987 DEBUG [Listener at localhost/34287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@193df40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:37,005 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:37,006 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing b5b7aa3312a3928563d14ec9b4ef3877, disabling compactions & flushes 2023-07-19 13:10:37,006 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. 2023-07-19 13:10:37,006 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. 2023-07-19 13:10:37,006 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. after waiting 0 ms 2023-07-19 13:10:37,006 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. 2023-07-19 13:10:37,006 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. 2023-07-19 13:10:37,006 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for b5b7aa3312a3928563d14ec9b4ef3877: 2023-07-19 13:10:37,011 DEBUG [hconnection-0x5dbe67be-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:37,013 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:10:37,015 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689772237014"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772237014"}]},"ts":"1689772237014"} 2023-07-19 13:10:37,018 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 13:10:37,019 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:10:37,020 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772237020"}]},"ts":"1689772237020"} 2023-07-19 13:10:37,023 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 13:10:37,025 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:37,028 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33091,1689772231406 2023-07-19 13:10:37,028 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-19 13:10:37,028 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/test.cache.data in system properties and HBase conf 2023-07-19 13:10:37,028 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 13:10:37,029 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop.log.dir in system properties and HBase conf 2023-07-19 13:10:37,029 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 13:10:37,029 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 13:10:37,029 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 13:10:37,029 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 13:10:37,029 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:10:37,029 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 13:10:37,029 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 13:10:37,029 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 13:10:37,030 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 13:10:37,030 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 13:10:37,030 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 13:10:37,030 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 13:10:37,030 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 13:10:37,030 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/nfs.dump.dir in system properties and HBase conf 2023-07-19 13:10:37,030 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/java.io.tmpdir in system properties and HBase conf 2023-07-19 13:10:37,030 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 13:10:37,030 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 13:10:37,030 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:10:37,031 INFO [Listener at localhost/34287] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-19 13:10:37,031 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:10:37,031 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:10:37,031 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:10:37,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=b5b7aa3312a3928563d14ec9b4ef3877, ASSIGN}] 2023-07-19 13:10:37,034 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=b5b7aa3312a3928563d14ec9b4ef3877, ASSIGN 2023-07-19 13:10:37,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 13:10:37,036 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=b5b7aa3312a3928563d14ec9b4ef3877, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40427,1689772233020; forceNewPlan=false, retain=false 2023-07-19 13:10:37,186 INFO [jenkins-hbase4:33091] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 13:10:37,187 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b5b7aa3312a3928563d14ec9b4ef3877, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:37,188 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689772237187"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772237187"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772237187"}]},"ts":"1689772237187"} 2023-07-19 13:10:37,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure b5b7aa3312a3928563d14ec9b4ef3877, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:10:37,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 13:10:37,358 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. 2023-07-19 13:10:37,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5b7aa3312a3928563d14ec9b4ef3877, NAME => 'hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877.', STARTKEY => '', ENDKEY => ''} 2023-07-19 13:10:37,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. service=AccessControlService 2023-07-19 13:10:37,360 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:37,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl b5b7aa3312a3928563d14ec9b4ef3877 2023-07-19 13:10:37,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:37,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5b7aa3312a3928563d14ec9b4ef3877 2023-07-19 13:10:37,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5b7aa3312a3928563d14ec9b4ef3877 2023-07-19 13:10:37,367 INFO [StoreOpener-b5b7aa3312a3928563d14ec9b4ef3877-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region b5b7aa3312a3928563d14ec9b4ef3877 2023-07-19 13:10:37,370 DEBUG [StoreOpener-b5b7aa3312a3928563d14ec9b4ef3877-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877/l 2023-07-19 13:10:37,370 DEBUG [StoreOpener-b5b7aa3312a3928563d14ec9b4ef3877-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877/l 2023-07-19 13:10:37,371 INFO [StoreOpener-b5b7aa3312a3928563d14ec9b4ef3877-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5b7aa3312a3928563d14ec9b4ef3877 columnFamilyName l 2023-07-19 13:10:37,372 INFO [StoreOpener-b5b7aa3312a3928563d14ec9b4ef3877-1] regionserver.HStore(310): Store=b5b7aa3312a3928563d14ec9b4ef3877/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:37,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877 2023-07-19 13:10:37,377 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877 2023-07-19 13:10:37,383 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5b7aa3312a3928563d14ec9b4ef3877 2023-07-19 13:10:37,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:10:37,388 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5b7aa3312a3928563d14ec9b4ef3877; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58779012, jitterRate=-0.12412446737289429}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:10:37,388 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5b7aa3312a3928563d14ec9b4ef3877: 2023-07-19 13:10:37,390 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877., pid=11, masterSystemTime=1689772237350 2023-07-19 13:10:37,395 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. 2023-07-19 13:10:37,395 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. 2023-07-19 13:10:37,396 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b5b7aa3312a3928563d14ec9b4ef3877, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:37,396 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689772237396"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772237396"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772237396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772237396"}]},"ts":"1689772237396"} 2023-07-19 13:10:37,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-19 13:10:37,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure b5b7aa3312a3928563d14ec9b4ef3877, server=jenkins-hbase4.apache.org,40427,1689772233020 in 208 msec 2023-07-19 13:10:37,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-19 13:10:37,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=b5b7aa3312a3928563d14ec9b4ef3877, ASSIGN in 374 msec 2023-07-19 13:10:37,416 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:10:37,416 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772237416"}]},"ts":"1689772237416"} 2023-07-19 13:10:37,419 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 13:10:37,433 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:10:37,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 521 msec 2023-07-19 13:10:37,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 13:10:37,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-19 13:10:37,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 13:10:38,558 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:38,972 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:38,982 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34565_jobhistory____.pro9k4/webapp 2023-07-19 13:10:39,189 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-19 13:10:39,189 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-19 13:10:39,189 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 13:10:39,194 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 13:10:39,291 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:39,629 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:40,078 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-19 13:10:40,119 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34565 2023-07-19 13:10:41,316 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:10:41,561 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 13:10:41,566 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 13:10:41,569 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 13:10:41,577 WARN [Listener at jenkins-hbase4.apache.org/40409] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:41,605 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:10:41,606 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 13:10:41,607 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:10:41,607 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 13:10:41,607 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 13:10:41,607 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 13:10:41,607 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:10:41,608 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 13:10:41,608 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 13:10:41,608 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 13:10:41,707 WARN [Listener at jenkins-hbase4.apache.org/40409] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 13:10:41,707 INFO [Listener at jenkins-hbase4.apache.org/40409] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:41,718 INFO [Listener at jenkins-hbase4.apache.org/40409] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46199_cluster____cl40s5/webapp 2023-07-19 13:10:41,796 INFO [Listener at jenkins-hbase4.apache.org/40409] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 13:10:41,796 INFO [Listener at jenkins-hbase4.apache.org/40409] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-19 13:10:41,797 INFO [Listener at jenkins-hbase4.apache.org/40409] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 13:10:41,797 INFO [Listener at jenkins-hbase4.apache.org/40409] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 13:10:41,805 INFO [Listener at jenkins-hbase4.apache.org/40409] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:42,018 INFO [Listener at jenkins-hbase4.apache.org/40409] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:42,120 INFO [Listener at jenkins-hbase4.apache.org/40409] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:42,130 INFO [Listener at jenkins-hbase4.apache.org/40409] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46199 2023-07-19 13:10:42,701 WARN [Listener at jenkins-hbase4.apache.org/44207] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:42,733 WARN [Listener at jenkins-hbase4.apache.org/44207] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 13:10:42,734 INFO [Listener at jenkins-hbase4.apache.org/44207] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:42,745 INFO [Listener at jenkins-hbase4.apache.org/44207] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45709_node____6neaot/webapp 2023-07-19 13:10:42,800 INFO [Listener at jenkins-hbase4.apache.org/44207] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 13:10:42,801 INFO [Listener at jenkins-hbase4.apache.org/44207] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 13:10:42,801 INFO [Listener at jenkins-hbase4.apache.org/44207] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 13:10:42,801 INFO [Listener at jenkins-hbase4.apache.org/44207] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 13:10:42,811 INFO [Listener at jenkins-hbase4.apache.org/44207] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:42,834 INFO [Listener at jenkins-hbase4.apache.org/44207] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:42,933 INFO [Listener at jenkins-hbase4.apache.org/44207] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:42,951 INFO [Listener at jenkins-hbase4.apache.org/44207] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45709 2023-07-19 13:10:43,250 WARN [Listener at jenkins-hbase4.apache.org/36809] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:43,258 WARN [Listener at jenkins-hbase4.apache.org/36809] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 13:10:43,259 INFO [Listener at jenkins-hbase4.apache.org/36809] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:43,270 INFO [Listener at jenkins-hbase4.apache.org/36809] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45721_node____q6ydhv/webapp 2023-07-19 13:10:43,347 INFO [Listener at jenkins-hbase4.apache.org/36809] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 13:10:43,348 INFO [Listener at jenkins-hbase4.apache.org/36809] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 13:10:43,348 INFO [Listener at jenkins-hbase4.apache.org/36809] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 13:10:43,348 INFO [Listener at jenkins-hbase4.apache.org/36809] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 13:10:43,360 INFO [Listener at jenkins-hbase4.apache.org/36809] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:43,382 INFO [Listener at jenkins-hbase4.apache.org/36809] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:43,476 INFO [Listener at jenkins-hbase4.apache.org/36809] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:43,483 INFO [Listener at jenkins-hbase4.apache.org/36809] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45721 2023-07-19 13:10:43,525 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-19 13:10:43,527 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:10:43,594 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=319, ProcessCount=177, AvailableMemoryMB=4894 2023-07-19 13:10:43,595 WARN [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-19 13:10:43,609 DEBUG [Listener at jenkins-hbase4.apache.org/36809] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 13:10:43,620 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 13:10:43,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 13:10:43,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:10:43,634 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:10:43,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-19 13:10:43,637 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:10:43,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 13:10:43,641 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:10:43,641 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7 2023-07-19 13:10:43,645 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7 empty. 2023-07-19 13:10:43,646 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79 empty. 2023-07-19 13:10:43,647 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7 2023-07-19 13:10:43,647 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:10:43,647 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 13:10:43,686 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-19 13:10:43,688 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => cf8577070a3b09438d1d99e9c944cb79, NAME => 'testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:10:43,688 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0db46ca89a620269fba4977221168fb7, NAME => 'testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:10:43,742 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:43,742 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 0db46ca89a620269fba4977221168fb7, disabling compactions & flushes 2023-07-19 13:10:43,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 13:10:43,742 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:10:43,743 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:10:43,743 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. after waiting 0 ms 2023-07-19 13:10:43,743 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:10:43,743 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:10:43,743 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 0db46ca89a620269fba4977221168fb7: 2023-07-19 13:10:43,753 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:43,753 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing cf8577070a3b09438d1d99e9c944cb79, disabling compactions & flushes 2023-07-19 13:10:43,753 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:43,753 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:43,753 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. after waiting 0 ms 2023-07-19 13:10:43,753 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:43,753 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:43,753 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for cf8577070a3b09438d1d99e9c944cb79: 2023-07-19 13:10:43,760 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:10:43,763 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772243762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772243762"}]},"ts":"1689772243762"} 2023-07-19 13:10:43,763 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772243762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772243762"}]},"ts":"1689772243762"} 2023-07-19 13:10:43,832 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:10:43,834 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:10:43,835 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772243834"}]},"ts":"1689772243834"} 2023-07-19 13:10:43,837 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-19 13:10:43,843 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:10:43,845 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:10:43,846 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:10:43,846 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:10:43,846 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:10:43,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf8577070a3b09438d1d99e9c944cb79, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0db46ca89a620269fba4977221168fb7, ASSIGN}] 2023-07-19 13:10:43,849 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf8577070a3b09438d1d99e9c944cb79, ASSIGN 2023-07-19 13:10:43,850 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0db46ca89a620269fba4977221168fb7, ASSIGN 2023-07-19 13:10:43,852 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0db46ca89a620269fba4977221168fb7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40427,1689772233020; forceNewPlan=false, retain=false 2023-07-19 13:10:43,852 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf8577070a3b09438d1d99e9c944cb79, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40947,1689772233100; forceNewPlan=false, retain=false 2023-07-19 13:10:43,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 13:10:44,002 INFO [jenkins-hbase4:33091] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:10:44,005 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0db46ca89a620269fba4977221168fb7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:44,005 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cf8577070a3b09438d1d99e9c944cb79, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:44,005 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772244005"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772244005"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772244005"}]},"ts":"1689772244005"} 2023-07-19 13:10:44,005 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772244005"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772244005"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772244005"}]},"ts":"1689772244005"} 2023-07-19 13:10:44,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 0db46ca89a620269fba4977221168fb7, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:10:44,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure cf8577070a3b09438d1d99e9c944cb79, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:10:44,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:10:44,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0db46ca89a620269fba4977221168fb7, NAME => 'testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 13:10:44,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:44,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. service=AccessControlService 2023-07-19 13:10:44,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf8577070a3b09438d1d99e9c944cb79, NAME => 'testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 13:10:44,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:44,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 0db46ca89a620269fba4977221168fb7 2023-07-19 13:10:44,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. service=AccessControlService 2023-07-19 13:10:44,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:44,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0db46ca89a620269fba4977221168fb7 2023-07-19 13:10:44,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0db46ca89a620269fba4977221168fb7 2023-07-19 13:10:44,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:44,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:10:44,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:44,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:10:44,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:10:44,179 INFO [StoreOpener-0db46ca89a620269fba4977221168fb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0db46ca89a620269fba4977221168fb7 2023-07-19 13:10:44,179 INFO [StoreOpener-cf8577070a3b09438d1d99e9c944cb79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:10:44,182 DEBUG [StoreOpener-cf8577070a3b09438d1d99e9c944cb79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/cf 2023-07-19 13:10:44,183 DEBUG [StoreOpener-cf8577070a3b09438d1d99e9c944cb79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/cf 2023-07-19 13:10:44,183 DEBUG [StoreOpener-0db46ca89a620269fba4977221168fb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/cf 2023-07-19 13:10:44,183 DEBUG [StoreOpener-0db46ca89a620269fba4977221168fb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/cf 2023-07-19 13:10:44,187 INFO [StoreOpener-cf8577070a3b09438d1d99e9c944cb79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf8577070a3b09438d1d99e9c944cb79 columnFamilyName cf 2023-07-19 13:10:44,191 INFO [StoreOpener-0db46ca89a620269fba4977221168fb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0db46ca89a620269fba4977221168fb7 columnFamilyName cf 2023-07-19 13:10:44,193 INFO [StoreOpener-cf8577070a3b09438d1d99e9c944cb79-1] regionserver.HStore(310): Store=cf8577070a3b09438d1d99e9c944cb79/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:44,195 INFO [StoreOpener-0db46ca89a620269fba4977221168fb7-1] regionserver.HStore(310): Store=0db46ca89a620269fba4977221168fb7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:44,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:10:44,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:10:44,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7 2023-07-19 13:10:44,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7 2023-07-19 13:10:44,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:10:44,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0db46ca89a620269fba4977221168fb7 2023-07-19 13:10:44,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:10:44,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cf8577070a3b09438d1d99e9c944cb79; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59054905, jitterRate=-0.12001334130764008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:10:44,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cf8577070a3b09438d1d99e9c944cb79: 2023-07-19 13:10:44,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:10:44,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79., pid=16, masterSystemTime=1689772244165 2023-07-19 13:10:44,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0db46ca89a620269fba4977221168fb7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70998372, jitterRate=0.05795818567276001}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:10:44,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0db46ca89a620269fba4977221168fb7: 2023-07-19 13:10:44,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7., pid=15, masterSystemTime=1689772244163 2023-07-19 13:10:44,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:44,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:44,222 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cf8577070a3b09438d1d99e9c944cb79, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:44,223 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772244222"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772244222"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772244222"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772244222"}]},"ts":"1689772244222"} 2023-07-19 13:10:44,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:10:44,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:10:44,225 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0db46ca89a620269fba4977221168fb7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:44,226 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772244225"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772244225"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772244225"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772244225"}]},"ts":"1689772244225"} 2023-07-19 13:10:44,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-19 13:10:44,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure cf8577070a3b09438d1d99e9c944cb79, server=jenkins-hbase4.apache.org,40947,1689772233100 in 218 msec 2023-07-19 13:10:44,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf8577070a3b09438d1d99e9c944cb79, ASSIGN in 387 msec 2023-07-19 13:10:44,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-19 13:10:44,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 0db46ca89a620269fba4977221168fb7, server=jenkins-hbase4.apache.org,40427,1689772233020 in 232 msec 2023-07-19 13:10:44,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 13:10:44,249 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-19 13:10:44,249 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0db46ca89a620269fba4977221168fb7, ASSIGN in 399 msec 2023-07-19 13:10:44,250 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:10:44,250 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772244250"}]},"ts":"1689772244250"} 2023-07-19 13:10:44,252 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-19 13:10:44,256 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:10:44,263 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-19 13:10:44,286 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 13:10:44,335 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 13:10:44,335 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 13:10:44,335 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 13:10:44,335 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:44,335 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 13:10:44,351 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 13:10:44,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 13:10:44,354 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 13:10:44,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 13:10:44,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 725 msec 2023-07-19 13:10:44,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 13:10:44,749 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-19 13:10:44,754 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 13:10:44,755 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:44,757 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:10:44,790 DEBUG [hconnection-0x5dbe67be-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:44,795 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:44,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 13:10:44,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772244815 (current time:1689772244815). 2023-07-19 13:10:44,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:10:44,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x73627810 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:44,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a93fc2a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:44,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:44,845 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:44,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73627810 to 127.0.0.1:64840 2023-07-19 13:10:44,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:10:44,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x02a8cf84 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:44,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f091890, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:44,864 DEBUG [hconnection-0x62a662d4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:44,869 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:44,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02a8cf84 to 127.0.0.1:64840 2023-07-19 13:10:44,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:10:44,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 13:10:44,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:10:44,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 13:10:44,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 13:10:44,936 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 13:10:44,938 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689772844938 2023-07-19 13:10:44,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 13:10:44,939 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 13:10:44,943 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 13:10:44,946 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:10:44,946 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:10:44,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 13:10:44,948 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-19 13:10:44,949 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 13:10:44,950 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689772844950 2023-07-19 13:10:44,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,985 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-19 13:10:44,985 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:44,986 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 13:10:44,987 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 13:10:44,987 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,987 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,992 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:44,992 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:44,992 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:44,992 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:44,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:44,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:44,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:44,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:44,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:44,993 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:44,993 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:44,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:44,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,993 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:44,994 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:10:44,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 13:10:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 13:10:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 13:10:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,995 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 13:10:44,995 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 13:10:44,998 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 13:10:44,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,999 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 13:10:44,999 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:44,999 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 13:10:45,000 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:45,002 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 13:10:45,002 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 13:10:45,002 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 13:10:45,002 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 13:10:45,002 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 13:10:45,002 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:45,002 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 13:10:45,003 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 13:10:45,003 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 13:10:45,003 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 13:10:45,003 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 13:10:45,005 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,006 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:45,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:45,006 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,007 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,007 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:10:45,007 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:45,008 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,008 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:10:45,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:45,008 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,009 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,009 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:10:45,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:45,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 13:10:45,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70ff91fe[Count = 1] remaining members to acquire global barrier 2023-07-19 13:10:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:45,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 13:10:45,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70ff91fe[Count = 0] remaining members to acquire global barrier 2023-07-19 13:10:45,014 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 13:10:45,014 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,018 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,018 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,018 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,018 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 13:10:45,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 13:10:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 13:10:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 13:10:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:10:45,019 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,020 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:10:45,020 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,020 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:10:45,020 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:45,020 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:10:45,020 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. started... 2023-07-19 13:10:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:10:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:10:45,021 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:10:45,021 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. started... 2023-07-19 13:10:45,024 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf8577070a3b09438d1d99e9c944cb79: 2023-07-19 13:10:45,024 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0db46ca89a620269fba4977221168fb7: 2023-07-19 13:10:45,025 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,025 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,032 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:10:45,032 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:10:45,032 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 13:10:45,033 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:45,033 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 13:10:45,037 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:10:45,037 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:10:45,047 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:10:45,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 13:10:45,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:10:45,052 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:10:45,093 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. completed. 2023-07-19 13:10:45,093 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. completed. 2023-07-19 13:10:45,093 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:10:45,093 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:10:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:10:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 13:10:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:10:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:10:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:10:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 13:10:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:10:45,097 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 13:10:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 13:10:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:45,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,097 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 13:10:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:45,098 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 13:10:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:45,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40427,1689772233020': 2023-07-19 13:10:45,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 13:10:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40947,1689772233100': 2023-07-19 13:10:45,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 13:10:45,112 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-19 13:10:45,112 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:10:45,112 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:10:45,112 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,112 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:10:45,116 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,116 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,116 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:45,116 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,116 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,116 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:45,116 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:45,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:45,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:45,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:45,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:45,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:45,121 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:45,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:45,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,122 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:45,122 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:45,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:45,126 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,126 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,126 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:45,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:45,144 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:45,144 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:45,144 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:45,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:45,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:45,145 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:45,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:45,145 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:45,145 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-19 13:10:45,144 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,146 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:45,144 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:45,147 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:45,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:45,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:45,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 13:10:45,146 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,148 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,148 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,148 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:45,148 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,148 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:45,148 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:45,148 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,148 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,147 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:45,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:45,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:45,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:45,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:45,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:45,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:45,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 13:10:45,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,252 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:10:45,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 13:10:45,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:10:45,253 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 13:10:45,283 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 13:10:45,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,284 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:45,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689772244939Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689772245174 (+235 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689772245174Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689772245174Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689772245191 (+17 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689772245222 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689772245283 (+61 ms) 2023-07-19 13:10:45,286 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 13:10:45,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 343 msec 2023-07-19 13:10:45,554 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:10:45,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 13:10:45,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:10:45,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40947] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:10:45,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40427] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:10:45,587 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 13:10:45,587 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:45,587 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:10:45,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 13:10:45,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772245605 (current time:1689772245605). 2023-07-19 13:10:45,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:10:45,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x4ad64868 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:45,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6050976a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:45,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:45,732 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:45,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ad64868 to 127.0.0.1:64840 2023-07-19 13:10:45,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:10:45,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x1fc74747 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:45,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@672ac9df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:45,915 DEBUG [hconnection-0x3a5f997-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:45,918 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:45,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fc74747 to 127.0.0.1:64840 2023-07-19 13:10:45,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:10:45,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 13:10:45,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:10:45,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 13:10:45,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 13:10:45,929 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 13:10:45,931 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689772845931 2023-07-19 13:10:45,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 13:10:45,931 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 13:10:45,932 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:10:45,932 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:10:45,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 13:10:45,934 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 13:10:45,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-19 13:10:45,937 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 13:10:45,938 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689772845938 2023-07-19 13:10:45,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-19 13:10:45,964 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-19 13:10:45,964 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:45,965 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 13:10:45,965 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 13:10:45,990 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,990 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,028 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:46,028 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:46,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:46,029 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:46,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:46,029 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:46,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:46,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:46,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:46,029 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,030 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,030 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,031 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:10:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 13:10:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 13:10:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 13:10:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,031 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 13:10:46,031 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 13:10:46,031 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 13:10:46,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 13:10:46,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 13:10:46,032 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 13:10:46,032 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 13:10:46,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 13:10:46,032 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:46,032 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 13:10:46,033 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:10:46,032 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:46,033 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:46,033 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 13:10:46,034 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 13:10:46,034 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 13:10:46,035 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 13:10:46,035 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 13:10:46,035 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 13:10:46,035 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 13:10:46,036 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 13:10:46,036 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 13:10:46,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 13:10:46,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:10:46,044 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:10:46,106 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,158 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,158 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,158 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:10:46,158 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,158 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,159 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:46,159 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,159 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:10:46,159 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,159 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:10:46,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:46,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:46,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:46,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:46,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:46,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:46,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 13:10:46,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@459309d1[Count = 1] remaining members to acquire global barrier 2023-07-19 13:10:46,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:46,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:46,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:46,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:46,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:46,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:46,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:46,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 13:10:46,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@459309d1[Count = 0] remaining members to acquire global barrier 2023-07-19 13:10:46,165 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 13:10:46,165 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,244 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:10:46,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 13:10:46,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:10:46,246 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 13:10:46,293 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,293 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,293 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,293 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,294 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 13:10:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,294 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 13:10:46,294 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 13:10:46,294 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 13:10:46,294 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:10:46,294 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,294 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:46,294 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:10:46,294 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:10:46,294 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:10:46,294 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:10:46,294 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:10:46,294 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. started... 2023-07-19 13:10:46,294 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:10:46,295 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. started... 2023-07-19 13:10:46,295 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cf8577070a3b09438d1d99e9c944cb79 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 13:10:46,295 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0db46ca89a620269fba4977221168fb7 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 13:10:46,345 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 13:10:46,345 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:46,345 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 13:10:46,444 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719b1060683c7544bfe839b3edbdccf4b25 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719b1060683c7544bfe839b3edbdccf4b25 2023-07-19 13:10:46,446 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071984595e99bf7741a7baf8cd13d11a10bc to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071984595e99bf7741a7baf8cd13d11a10bc 2023-07-19 13:10:46,486 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/.tmp/cf/35a78aa94d0141ac92a1798ef70e9bc8 2023-07-19 13:10:46,487 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/.tmp/cf/98448faeadb0459dbd7c8507c7836750 2023-07-19 13:10:46,500 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/.tmp/cf/98448faeadb0459dbd7c8507c7836750 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/cf/98448faeadb0459dbd7c8507c7836750 2023-07-19 13:10:46,500 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/.tmp/cf/35a78aa94d0141ac92a1798ef70e9bc8 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/cf/35a78aa94d0141ac92a1798ef70e9bc8 2023-07-19 13:10:46,510 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/cf/98448faeadb0459dbd7c8507c7836750, entries=46, sequenceid=6, filesize=12.6 K 2023-07-19 13:10:46,516 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 0db46ca89a620269fba4977221168fb7 in 220ms, sequenceid=6, compaction requested=false 2023-07-19 13:10:46,516 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 13:10:46,516 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/cf/35a78aa94d0141ac92a1798ef70e9bc8, entries=4, sequenceid=6, filesize=5.6 K 2023-07-19 13:10:46,518 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0db46ca89a620269fba4977221168fb7: 2023-07-19 13:10:46,519 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 13:10:46,519 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for cf8577070a3b09438d1d99e9c944cb79 in 224ms, sequenceid=6, compaction requested=false 2023-07-19 13:10:46,519 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:10:46,520 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf8577070a3b09438d1d99e9c944cb79: 2023-07-19 13:10:46,520 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/cf/98448faeadb0459dbd7c8507c7836750] hfiles 2023-07-19 13:10:46,520 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/cf/98448faeadb0459dbd7c8507c7836750 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 13:10:46,520 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 13:10:46,520 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:10:46,520 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/cf/35a78aa94d0141ac92a1798ef70e9bc8] hfiles 2023-07-19 13:10:46,520 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/cf/35a78aa94d0141ac92a1798ef70e9bc8 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 13:10:46,546 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:10:46,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 13:10:46,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:10:46,548 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 13:10:46,548 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. completed. 2023-07-19 13:10:46,548 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:10:46,548 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:10:46,548 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:10:46,548 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,549 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 13:10:46,549 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:10:46,550 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. completed. 2023-07-19 13:10:46,550 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:10:46,550 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:10:46,550 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:10:46,550 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,550 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 13:10:46,550 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:10:46,589 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,589 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 13:10:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:46,589 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:46,589 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 13:10:46,650 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:46,651 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 13:10:46,651 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:46,651 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 13:10:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40427,1689772233020': 2023-07-19 13:10:46,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 13:10:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40947,1689772233100': 2023-07-19 13:10:46,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 13:10:46,662 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-19 13:10:46,662 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:10:46,662 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:10:46,662 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-19 13:10:46,662 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:10:46,735 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,735 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,735 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:46,735 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,736 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:46,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,735 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,736 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:46,736 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:46,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:46,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:46,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:46,737 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:46,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:46,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:46,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,739 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:46,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:46,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:46,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:46,744 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:46,745 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:46,745 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:46,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:46,843 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:46,843 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:46,843 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:46,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:46,843 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:46,843 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:46,843 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:46,843 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,843 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:46,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:46,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:46,843 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:46,843 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-19 13:10:46,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:46,845 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-19 13:10:46,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:46,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:46,845 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 13:10:46,845 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:46,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:46,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:46,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:46,846 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 13:10:46,846 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:10:46,846 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,846 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:10:46,846 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:10:46,846 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,846 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:46,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:46,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719b1060683c7544bfe839b3edbdccf4b25, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071984595e99bf7741a7baf8cd13d11a10bc] mob files 2023-07-19 13:10:46,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719b1060683c7544bfe839b3edbdccf4b25 2023-07-19 13:10:46,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071984595e99bf7741a7baf8cd13d11a10bc 2023-07-19 13:10:46,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-19 13:10:46,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 13:10:46,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,960 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 13:10:46,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689772245931Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689772246868 (+937 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689772246868Loading Region manifests for snaptb0-testExportWithTargetName at 1689772246868Writing data manifest for snaptb0-testExportWithTargetName at 1689772246873 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689772246897 (+24 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689772246959 (+62 ms) 2023-07-19 13:10:46,962 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 13:10:46,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.0300 sec 2023-07-19 13:10:47,048 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:10:47,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 13:10:47,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:10:47,052 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772247052 2023-07-19 13:10:47,053 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42143, tgtDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772247052, rawTgtDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772247052, srcFsUri=hdfs://localhost:42143, srcDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:10:47,102 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:10:47,103 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212423302_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772247052, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772247052/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 13:10:47,103 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5, snapshotDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-19 13:10:47,136 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772247052/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 13:10:47,661 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:47,662 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:47,662 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:47,663 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:48,779 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-9173375378707373191.jar 2023-07-19 13:10:48,779 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:48,780 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:48,848 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-2128082118376692500.jar 2023-07-19 13:10:48,849 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:48,849 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:48,850 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:48,850 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:48,851 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:48,851 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:48,852 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:10:48,852 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:10:48,853 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:10:48,854 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:10:48,854 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:10:48,855 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:10:48,856 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:10:48,856 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:10:48,857 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:10:48,858 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:10:48,863 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:10:48,864 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:10:48,864 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:10:48,864 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:10:48,865 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:10:48,865 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:10:48,866 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:10:49,694 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:10:50,084 WARN [Listener at jenkins-hbase4.apache.org/36809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:10:50,091 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-19 13:10:50,101 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-19 13:10:50,606 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:10:50,606 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:10:51,322 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0001_000001 (auth:SIMPLE) 2023-07-19 13:10:56,482 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0001_000001 (auth:SIMPLE) 2023-07-19 13:10:58,789 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0001_000001 (auth:SIMPLE) 2023-07-19 13:11:01,707 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0001_000001 (auth:SIMPLE) 2023-07-19 13:11:03,009 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:11:03,011 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:11:03,022 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-19 13:11:03,023 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:11:03,023 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:11:03,024 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583241713_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 13:11:03,024 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-19 13:11:03,024 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-19 13:11:03,024 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583241713_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772247052/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772247052/.hbase-snapshot/testExportWithTargetName 2023-07-19 13:11:03,025 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772247052/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-19 13:11:03,025 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772247052/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-19 13:11:03,036 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-19 13:11:03,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-19 13:11:03,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:03,056 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772263056"}]},"ts":"1689772263056"} 2023-07-19 13:11:03,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 13:11:03,061 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-19 13:11:03,063 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-19 13:11:03,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf8577070a3b09438d1d99e9c944cb79, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0db46ca89a620269fba4977221168fb7, UNASSIGN}] 2023-07-19 13:11:03,070 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0db46ca89a620269fba4977221168fb7, UNASSIGN 2023-07-19 13:11:03,070 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf8577070a3b09438d1d99e9c944cb79, UNASSIGN 2023-07-19 13:11:03,071 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=cf8577070a3b09438d1d99e9c944cb79, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:03,071 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0db46ca89a620269fba4977221168fb7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:03,071 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772263071"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772263071"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772263071"}]},"ts":"1689772263071"} 2023-07-19 13:11:03,071 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772263071"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772263071"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772263071"}]},"ts":"1689772263071"} 2023-07-19 13:11:03,074 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure cf8577070a3b09438d1d99e9c944cb79, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:11:03,080 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 0db46ca89a620269fba4977221168fb7, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:11:03,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 13:11:03,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0db46ca89a620269fba4977221168fb7 2023-07-19 13:11:03,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:11:03,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0db46ca89a620269fba4977221168fb7, disabling compactions & flushes 2023-07-19 13:11:03,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cf8577070a3b09438d1d99e9c944cb79, disabling compactions & flushes 2023-07-19 13:11:03,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:11:03,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:11:03,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:11:03,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:11:03,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. after waiting 0 ms 2023-07-19 13:11:03,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. after waiting 0 ms 2023-07-19 13:11:03,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:11:03,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:11:03,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:11:03,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:11:03,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:03,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:03,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7. 2023-07-19 13:11:03,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79. 2023-07-19 13:11:03,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0db46ca89a620269fba4977221168fb7: 2023-07-19 13:11:03,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cf8577070a3b09438d1d99e9c944cb79: 2023-07-19 13:11:03,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0db46ca89a620269fba4977221168fb7 2023-07-19 13:11:03,258 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0db46ca89a620269fba4977221168fb7, regionState=CLOSED 2023-07-19 13:11:03,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:11:03,259 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772263258"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772263258"}]},"ts":"1689772263258"} 2023-07-19 13:11:03,259 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=cf8577070a3b09438d1d99e9c944cb79, regionState=CLOSED 2023-07-19 13:11:03,259 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772263259"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772263259"}]},"ts":"1689772263259"} 2023-07-19 13:11:03,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-19 13:11:03,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 0db46ca89a620269fba4977221168fb7, server=jenkins-hbase4.apache.org,40427,1689772233020 in 180 msec 2023-07-19 13:11:03,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-19 13:11:03,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure cf8577070a3b09438d1d99e9c944cb79, server=jenkins-hbase4.apache.org,40947,1689772233100 in 188 msec 2023-07-19 13:11:03,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0db46ca89a620269fba4977221168fb7, UNASSIGN in 197 msec 2023-07-19 13:11:03,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-19 13:11:03,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=cf8577070a3b09438d1d99e9c944cb79, UNASSIGN in 199 msec 2023-07-19 13:11:03,268 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772263268"}]},"ts":"1689772263268"} 2023-07-19 13:11:03,270 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-19 13:11:03,271 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-19 13:11:03,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 228 msec 2023-07-19 13:11:03,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 13:11:03,360 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-19 13:11:03,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-19 13:11:03,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:03,378 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:03,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-19 13:11:03,382 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:03,385 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-19 13:11:03,389 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 13:11:03,389 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 13:11:03,389 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 13:11:03,389 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 13:11:03,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 13:11:03,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 13:11:03,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 13:11:03,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-19 13:11:03,392 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 13:11:03,392 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 13:11:03,392 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:03,392 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:03,392 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:11:03,395 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 13:11:03,395 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:03,395 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 13:11:03,395 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:03,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 13:11:03,399 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7 2023-07-19 13:11:03,405 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/recovered.edits] 2023-07-19 13:11:03,405 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/recovered.edits] 2023-07-19 13:11:03,418 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/cf/35a78aa94d0141ac92a1798ef70e9bc8 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/cf/35a78aa94d0141ac92a1798ef70e9bc8 2023-07-19 13:11:03,418 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/cf/98448faeadb0459dbd7c8507c7836750 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/cf/98448faeadb0459dbd7c8507c7836750 2023-07-19 13:11:03,426 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/recovered.edits/9.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7/recovered.edits/9.seqid 2023-07-19 13:11:03,426 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/recovered.edits/9.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79/recovered.edits/9.seqid 2023-07-19 13:11:03,427 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/0db46ca89a620269fba4977221168fb7 2023-07-19 13:11:03,427 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportWithTargetName/cf8577070a3b09438d1d99e9c944cb79 2023-07-19 13:11:03,427 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 13:11:03,428 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-19 13:11:03,429 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-19 13:11:03,434 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719b1060683c7544bfe839b3edbdccf4b25 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230719b1060683c7544bfe839b3edbdccf4b25 2023-07-19 13:11:03,436 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071984595e99bf7741a7baf8cd13d11a10bc to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071984595e99bf7741a7baf8cd13d11a10bc 2023-07-19 13:11:03,436 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-19 13:11:03,441 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:03,464 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-19 13:11:03,467 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-19 13:11:03,469 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:03,469 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-19 13:11:03,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772263469"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:03,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772263469"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:03,471 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 13:11:03,471 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cf8577070a3b09438d1d99e9c944cb79, NAME => 'testtb-testExportWithTargetName,,1689772243628.cf8577070a3b09438d1d99e9c944cb79.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0db46ca89a620269fba4977221168fb7, NAME => 'testtb-testExportWithTargetName,1,1689772243628.0db46ca89a620269fba4977221168fb7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 13:11:03,471 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-19 13:11:03,472 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772263472"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:03,474 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-19 13:11:03,476 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:03,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 110 msec 2023-07-19 13:11:03,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 13:11:03,501 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-19 13:11:03,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-19 13:11:03,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-19 13:11:03,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-19 13:11:03,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-19 13:11:03,557 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 707) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:59332 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:36311 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:44207 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1462073963_1 at /127.0.0.1:37968 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:46775 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1462073963_1 at /127.0.0.1:34646 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:37994 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:34660 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1317 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=360 (was 319) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=3136 (was 4894) 2023-07-19 13:11:03,558 WARN [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-19 13:11:03,578 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=360, ProcessCount=183, AvailableMemoryMB=3136 2023-07-19 13:11:03,578 WARN [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-19 13:11:03,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 13:11:03,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:03,586 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:11:03,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-19 13:11:03,588 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:11:03,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 13:11:03,591 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:03,591 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:03,592 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955 empty. 2023-07-19 13:11:03,592 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300 empty. 2023-07-19 13:11:03,592 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:03,592 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:03,593 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 13:11:03,605 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 13:11:03,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8fd94c5e16b69d854eed5de34e101955, NAME => 'testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:11:03,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e31b11c6cb3a6b0d67a9ebcc04a2b300, NAME => 'testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:11:03,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:03,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e31b11c6cb3a6b0d67a9ebcc04a2b300, disabling compactions & flushes 2023-07-19 13:11:03,630 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:03,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:03,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. after waiting 0 ms 2023-07-19 13:11:03,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:03,630 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:03,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e31b11c6cb3a6b0d67a9ebcc04a2b300: 2023-07-19 13:11:03,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:03,633 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8fd94c5e16b69d854eed5de34e101955, disabling compactions & flushes 2023-07-19 13:11:03,634 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:03,634 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:03,634 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. after waiting 0 ms 2023-07-19 13:11:03,634 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:03,634 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:03,634 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8fd94c5e16b69d854eed5de34e101955: 2023-07-19 13:11:03,637 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:11:03,638 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772263638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772263638"}]},"ts":"1689772263638"} 2023-07-19 13:11:03,638 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772263638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772263638"}]},"ts":"1689772263638"} 2023-07-19 13:11:03,640 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:11:03,641 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:11:03,642 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772263642"}]},"ts":"1689772263642"} 2023-07-19 13:11:03,643 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 13:11:03,647 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:11:03,649 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:11:03,649 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:11:03,649 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:11:03,649 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:11:03,649 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd94c5e16b69d854eed5de34e101955, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e31b11c6cb3a6b0d67a9ebcc04a2b300, ASSIGN}] 2023-07-19 13:11:03,652 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd94c5e16b69d854eed5de34e101955, ASSIGN 2023-07-19 13:11:03,652 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e31b11c6cb3a6b0d67a9ebcc04a2b300, ASSIGN 2023-07-19 13:11:03,653 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e31b11c6cb3a6b0d67a9ebcc04a2b300, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41603,1689772232926; forceNewPlan=false, retain=false 2023-07-19 13:11:03,653 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd94c5e16b69d854eed5de34e101955, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40427,1689772233020; forceNewPlan=false, retain=false 2023-07-19 13:11:03,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 13:11:03,803 INFO [jenkins-hbase4:33091] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:11:03,806 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e31b11c6cb3a6b0d67a9ebcc04a2b300, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:03,806 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8fd94c5e16b69d854eed5de34e101955, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:03,806 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772263806"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772263806"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772263806"}]},"ts":"1689772263806"} 2023-07-19 13:11:03,806 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772263806"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772263806"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772263806"}]},"ts":"1689772263806"} 2023-07-19 13:11:03,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure e31b11c6cb3a6b0d67a9ebcc04a2b300, server=jenkins-hbase4.apache.org,41603,1689772232926}] 2023-07-19 13:11:03,810 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 8fd94c5e16b69d854eed5de34e101955, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:11:03,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 13:11:03,962 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:03,963 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 13:11:03,966 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 13:11:03,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:03,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8fd94c5e16b69d854eed5de34e101955, NAME => 'testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 13:11:03,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. service=AccessControlService 2023-07-19 13:11:03,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:03,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:03,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:03,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:03,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:03,975 INFO [StoreOpener-8fd94c5e16b69d854eed5de34e101955-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:03,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:03,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e31b11c6cb3a6b0d67a9ebcc04a2b300, NAME => 'testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 13:11:03,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. service=AccessControlService 2023-07-19 13:11:03,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:03,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:03,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:03,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:03,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:03,976 DEBUG [StoreOpener-8fd94c5e16b69d854eed5de34e101955-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/cf 2023-07-19 13:11:03,976 DEBUG [StoreOpener-8fd94c5e16b69d854eed5de34e101955-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/cf 2023-07-19 13:11:03,977 INFO [StoreOpener-8fd94c5e16b69d854eed5de34e101955-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fd94c5e16b69d854eed5de34e101955 columnFamilyName cf 2023-07-19 13:11:03,977 INFO [StoreOpener-e31b11c6cb3a6b0d67a9ebcc04a2b300-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:03,979 DEBUG [StoreOpener-e31b11c6cb3a6b0d67a9ebcc04a2b300-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/cf 2023-07-19 13:11:03,979 DEBUG [StoreOpener-e31b11c6cb3a6b0d67a9ebcc04a2b300-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/cf 2023-07-19 13:11:03,979 INFO [StoreOpener-8fd94c5e16b69d854eed5de34e101955-1] regionserver.HStore(310): Store=8fd94c5e16b69d854eed5de34e101955/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:03,980 INFO [StoreOpener-e31b11c6cb3a6b0d67a9ebcc04a2b300-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e31b11c6cb3a6b0d67a9ebcc04a2b300 columnFamilyName cf 2023-07-19 13:11:03,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:03,981 INFO [StoreOpener-e31b11c6cb3a6b0d67a9ebcc04a2b300-1] regionserver.HStore(310): Store=e31b11c6cb3a6b0d67a9ebcc04a2b300/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:03,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:03,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:03,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:03,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:03,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:03,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:03,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8fd94c5e16b69d854eed5de34e101955; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60350102, jitterRate=-0.10071340203285217}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:03,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8fd94c5e16b69d854eed5de34e101955: 2023-07-19 13:11:03,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955., pid=31, masterSystemTime=1689772263962 2023-07-19 13:11:03,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:03,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e31b11c6cb3a6b0d67a9ebcc04a2b300; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63762639, jitterRate=-0.049862638115882874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:03,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e31b11c6cb3a6b0d67a9ebcc04a2b300: 2023-07-19 13:11:03,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300., pid=30, masterSystemTime=1689772263962 2023-07-19 13:11:03,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:03,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:04,000 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8fd94c5e16b69d854eed5de34e101955, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:04,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:04,001 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772264000"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772264000"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772264000"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772264000"}]},"ts":"1689772264000"} 2023-07-19 13:11:04,003 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e31b11c6cb3a6b0d67a9ebcc04a2b300, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,003 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772264003"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772264003"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772264003"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772264003"}]},"ts":"1689772264003"} 2023-07-19 13:11:04,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-19 13:11:04,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 8fd94c5e16b69d854eed5de34e101955, server=jenkins-hbase4.apache.org,40427,1689772233020 in 193 msec 2023-07-19 13:11:04,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-19 13:11:04,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure e31b11c6cb3a6b0d67a9ebcc04a2b300, server=jenkins-hbase4.apache.org,41603,1689772232926 in 196 msec 2023-07-19 13:11:04,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd94c5e16b69d854eed5de34e101955, ASSIGN in 359 msec 2023-07-19 13:11:04,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-19 13:11:04,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e31b11c6cb3a6b0d67a9ebcc04a2b300, ASSIGN in 361 msec 2023-07-19 13:11:04,015 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:11:04,015 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772264015"}]},"ts":"1689772264015"} 2023-07-19 13:11:04,017 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 13:11:04,020 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:11:04,020 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-19 13:11:04,022 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 13:11:04,025 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:04,025 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:04,025 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:04,025 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:04,027 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:04,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:04,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:04,028 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:04,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 446 msec 2023-07-19 13:11:04,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 13:11:04,193 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-19 13:11:04,196 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 13:11:04,196 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:04,199 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:04,211 DEBUG [hconnection-0x5dbe67be-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:04,217 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:04,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:11:04,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772264221 (current time:1689772264221). 2023-07-19 13:11:04,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:04,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x16ee60f9 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:04,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d40c13d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:04,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:04,236 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:04,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16ee60f9 to 127.0.0.1:64840 2023-07-19 13:11:04,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:04,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x1a30f864 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:04,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f3caa73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:04,247 DEBUG [hconnection-0x646ec580-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:04,248 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54068, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:04,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a30f864 to 127.0.0.1:64840 2023-07-19 13:11:04,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:04,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 13:11:04,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:04,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:11:04,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:11:04,259 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:11:04,263 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689772864263 2023-07-19 13:11:04,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:11:04,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 13:11:04,263 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:04,265 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:04,267 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:11:04,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 13:11:04,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-19 13:11:04,277 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 13:11:04,278 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689772864278 2023-07-19 13:11:04,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,295 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-19 13:11:04,295 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:04,297 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 13:11:04,297 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 13:11:04,298 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,298 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,301 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:04,301 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:04,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:04,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:04,302 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,302 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:04,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,302 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,302 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,303 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,303 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 13:11:04,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 13:11:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 13:11:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 13:11:04,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 13:11:04,304 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 13:11:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,304 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:04,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 13:11:04,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,306 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 13:11:04,306 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 13:11:04,306 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 13:11:04,306 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 13:11:04,307 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:04,308 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,308 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:04,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:04,309 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,309 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:04,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:04,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:04,311 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 13:11:04,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,311 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 13:11:04,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,311 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 13:11:04,311 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 13:11:04,311 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:04,313 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 13:11:04,313 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 13:11:04,313 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 13:11:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:04,318 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 13:11:04,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58bd021c[Count = 1] remaining members to acquire global barrier 2023-07-19 13:11:04,319 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,319 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,319 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:04,319 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:04,320 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,320 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:04,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 13:11:04,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58bd021c[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:04,323 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 13:11:04,323 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,324 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,324 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,324 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,324 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:11:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,324 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:11:04,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,324 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 13:11:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:11:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:04,325 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:04,325 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,325 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:04,325 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. started... 2023-07-19 13:11:04,325 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:11:04,327 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:04,327 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e31b11c6cb3a6b0d67a9ebcc04a2b300: 2023-07-19 13:11:04,327 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:04,327 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:04,327 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. started... 2023-07-19 13:11:04,327 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,327 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:04,327 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd94c5e16b69d854eed5de34e101955: 2023-07-19 13:11:04,327 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:11:04,328 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,328 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:04,328 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:11:04,328 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 13:11:04,328 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:04,328 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 13:11:04,369 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:04,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:11:04,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:04,371 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:04,373 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. completed. 2023-07-19 13:11:04,373 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:04,373 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:04,373 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:04,373 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,373 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 13:11:04,373 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:11:04,375 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 13:11:04,375 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:04,375 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 13:11:04,375 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41603,1689772232926': 2023-07-19 13:11:04,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 13:11:04,571 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:04,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:11:04,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:04,573 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 13:11:04,774 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. completed. 2023-07-19 13:11:04,774 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:04,774 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:04,774 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:04,775 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,775 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 13:11:04,775 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:11:04,778 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 13:11:04,778 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:04,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:04,778 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:04,779 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 13:11:04,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:04,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:04,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:04,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40427,1689772233020': 2023-07-19 13:11:04,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 13:11:04,788 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-19 13:11:04,788 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:04,788 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:04,788 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,788 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:04,790 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,790 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:04,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,790 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,790 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,790 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,791 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,791 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:04,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:04,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:04,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:04,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:04,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:04,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:04,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,792 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,793 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:04,794 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:04,797 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,798 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,798 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,802 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:04,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:04,802 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:04,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:04,803 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:04,803 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:04,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:04,803 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:04,803 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,803 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,803 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:04,803 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,803 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:04,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:04,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:04,804 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,804 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:04,804 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:04,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:04,804 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,804 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,804 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,804 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,805 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:04,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-19 13:11:04,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 13:11:04,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 13:11:04,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,874 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:04,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 13:11:04,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,874 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:04,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689772264263Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689772264826 (+563 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689772264826Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689772264826Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689772264831 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689772264844 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689772264874 (+30 ms) 2023-07-19 13:11:04,877 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 13:11:04,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:11:04,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:04,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 612 msec 2023-07-19 13:11:04,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40427] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:11:04,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41603] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:11:04,888 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 13:11:04,888 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:04,889 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:04,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:11:04,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772264900 (current time:1689772264900). 2023-07-19 13:11:04,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:04,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x39381547 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:04,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a696ac5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:04,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:04,910 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:04,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39381547 to 127.0.0.1:64840 2023-07-19 13:11:04,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:04,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x3a779488 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:04,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e25958, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:04,920 DEBUG [hconnection-0xeb0ad8f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:04,922 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:04,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a779488 to 127.0.0.1:64840 2023-07-19 13:11:04,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:04,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 13:11:04,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:04,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:11:04,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:11:04,932 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:11:04,933 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689772864933 2023-07-19 13:11:04,933 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 13:11:04,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:11:04,934 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:04,934 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:04,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 13:11:04,936 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:11:04,939 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-19 13:11:04,940 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 13:11:04,943 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689772864943 2023-07-19 13:11:04,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-19 13:11:04,962 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-19 13:11:04,962 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:04,964 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 13:11:04,964 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 13:11:04,964 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,965 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,966 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:04,966 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:04,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:04,966 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:04,966 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:04,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:04,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:04,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:04,966 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,966 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:04,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,967 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,967 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:04,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 13:11:04,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 13:11:04,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 13:11:04,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 13:11:04,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 13:11:04,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,968 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 13:11:04,968 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 13:11:04,968 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 13:11:04,968 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 13:11:04,968 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 13:11:04,968 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 13:11:04,968 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:04,968 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:04,969 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 13:11:04,970 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 13:11:04,970 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 13:11:04,968 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 13:11:04,970 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 13:11:04,970 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:04,970 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 13:11:04,971 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 13:11:04,971 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 13:11:04,971 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 13:11:04,971 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 13:11:04,975 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,975 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,976 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:04,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:04,976 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,976 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,977 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:04,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:04,977 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,977 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:04,977 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,977 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:04,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:04,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:04,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:04,978 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 13:11:04,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73134361[Count = 1] remaining members to acquire global barrier 2023-07-19 13:11:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:04,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:04,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 13:11:04,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73134361[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:04,981 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 13:11:04,981 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,982 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,982 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,982 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,983 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:11:04,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:11:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:11:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 13:11:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:11:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:04,983 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:04,983 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:04,983 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:04,983 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. started... 2023-07-19 13:11:04,983 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. started... 2023-07-19 13:11:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:04,983 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:04,983 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8fd94c5e16b69d854eed5de34e101955 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-19 13:11:04,984 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e31b11c6cb3a6b0d67a9ebcc04a2b300 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-19 13:11:04,983 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:04,985 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 13:11:04,985 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:04,985 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 13:11:05,013 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307193c46e20592eb41cca6eea616ef971742 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307193c46e20592eb41cca6eea616ef971742 2023-07-19 13:11:05,014 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719c4fe4bfb5ead4d5889d82f4c318f5b38 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719c4fe4bfb5ead4d5889d82f4c318f5b38 2023-07-19 13:11:05,033 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/.tmp/cf/335522ef3ee346868f0110271b5fb516 2023-07-19 13:11:05,036 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:05,037 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/.tmp/cf/96ba42cc81cf40eeb63207a4193a0fdd 2023-07-19 13:11:05,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:11:05,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:05,038 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:05,044 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/.tmp/cf/96ba42cc81cf40eeb63207a4193a0fdd as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/cf/96ba42cc81cf40eeb63207a4193a0fdd 2023-07-19 13:11:05,044 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/.tmp/cf/335522ef3ee346868f0110271b5fb516 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/cf/335522ef3ee346868f0110271b5fb516 2023-07-19 13:11:05,050 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/cf/96ba42cc81cf40eeb63207a4193a0fdd, entries=48, sequenceid=6, filesize=13.0 K 2023-07-19 13:11:05,051 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/cf/335522ef3ee346868f0110271b5fb516, entries=2, sequenceid=6, filesize=5.2 K 2023-07-19 13:11:05,052 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 8fd94c5e16b69d854eed5de34e101955 in 69ms, sequenceid=6, compaction requested=false 2023-07-19 13:11:05,052 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for e31b11c6cb3a6b0d67a9ebcc04a2b300 in 69ms, sequenceid=6, compaction requested=false 2023-07-19 13:11:05,052 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 13:11:05,052 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 13:11:05,055 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd94c5e16b69d854eed5de34e101955: 2023-07-19 13:11:05,055 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e31b11c6cb3a6b0d67a9ebcc04a2b300: 2023-07-19 13:11:05,055 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 13:11:05,055 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 13:11:05,055 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:05,055 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:05,055 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/cf/335522ef3ee346868f0110271b5fb516] hfiles 2023-07-19 13:11:05,055 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/cf/96ba42cc81cf40eeb63207a4193a0fdd] hfiles 2023-07-19 13:11:05,055 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/cf/96ba42cc81cf40eeb63207a4193a0fdd for snapshot=snaptb0-testExportFileSystemState 2023-07-19 13:11:05,055 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/cf/335522ef3ee346868f0110271b5fb516 for snapshot=snaptb0-testExportFileSystemState 2023-07-19 13:11:05,075 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. completed. 2023-07-19 13:11:05,075 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:05,075 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:05,075 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:05,075 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,075 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 13:11:05,075 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:11:05,084 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. completed. 2023-07-19 13:11:05,084 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:05,084 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:05,084 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:05,084 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,084 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 13:11:05,084 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:11:05,085 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 13:11:05,085 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,085 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:05,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:05,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:05,085 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 13:11:05,088 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 13:11:05,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:05,088 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,088 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:05,088 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 13:11:05,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:05,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:05,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:05,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:05,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:05,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:05,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40427,1689772233020': 2023-07-19 13:11:05,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 13:11:05,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:05,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:05,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:05,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:05,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:05,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:05,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41603,1689772232926': 2023-07-19 13:11:05,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 13:11:05,096 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-19 13:11:05,096 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:05,096 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:05,096 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-19 13:11:05,096 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:05,098 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,098 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,098 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:05,098 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:05,098 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,098 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,098 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:05,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:05,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:05,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,099 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,099 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:05,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:05,100 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,103 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:05,103 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:05,103 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:05,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,107 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:05,107 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:05,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:05,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:05,108 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:05,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:05,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:05,108 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:05,108 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:05,108 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:05,107 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,108 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-19 13:11:05,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:05,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:05,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:05,108 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:05,110 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-19 13:11:05,110 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:05,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 13:11:05,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:05,110 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:05,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:05,110 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:05,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 13:11:05,110 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,110 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:05,110 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,110 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:05,110 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:05,110 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,111 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719c4fe4bfb5ead4d5889d82f4c318f5b38, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307193c46e20592eb41cca6eea616ef971742] mob files 2023-07-19 13:11:05,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719c4fe4bfb5ead4d5889d82f4c318f5b38 2023-07-19 13:11:05,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307193c46e20592eb41cca6eea616ef971742 2023-07-19 13:11:05,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-19 13:11:05,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,172 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 13:11:05,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,174 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689772264933Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689772265121 (+188 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689772265121Loading Region manifests for snaptb0-testExportFileSystemState at 1689772265121Writing data manifest for snaptb0-testExportFileSystemState at 1689772265125 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689772265135 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689772265172 (+37 ms) 2023-07-19 13:11:05,178 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 13:11:05,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 244 msec 2023-07-19 13:11:05,238 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:05,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:11:05,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:05,240 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772265240 2023-07-19 13:11:05,240 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42143, tgtDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772265240, rawTgtDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772265240, srcFsUri=hdfs://localhost:42143, srcDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:11:05,274 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:11:05,274 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_866419229_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772265240, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772265240/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,274 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5, snapshotDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-19 13:11:05,290 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772265240/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 13:11:05,321 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:05,321 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:05,322 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:05,323 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:06,260 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-1699575140676292925.jar 2023-07-19 13:11:06,261 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:06,261 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:06,332 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-3151161511171371367.jar 2023-07-19 13:11:06,332 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:06,333 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:06,333 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:06,334 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:06,334 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:06,334 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:06,335 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:11:06,335 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:11:06,336 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:11:06,336 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:11:06,336 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:11:06,337 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:11:06,337 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:11:06,338 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:11:06,338 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:11:06,339 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:11:06,340 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:06,340 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:06,341 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:06,341 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:06,342 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:06,342 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:06,343 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:07,766 WARN [Listener at jenkins-hbase4.apache.org/36809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:11:07,771 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-19 13:11:07,774 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-19 13:11:07,864 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0001_000001 (auth:SIMPLE) 2023-07-19 13:11:07,969 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:07,969 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:08,537 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0002_000001 (auth:SIMPLE) 2023-07-19 13:11:08,852 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:11:13,200 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0002_000001 (auth:SIMPLE) 2023-07-19 13:11:15,502 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0002_000001 (auth:SIMPLE) 2023-07-19 13:11:18,202 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0002_000001 (auth:SIMPLE) 2023-07-19 13:11:20,104 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:11:20,115 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:11:20,137 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-19 13:11:20,137 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:11:20,138 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:11:20,138 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583241713_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 13:11:20,140 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 13:11:20,140 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 13:11:20,140 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583241713_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772265240/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772265240/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 13:11:20,141 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772265240/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 13:11:20,141 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772265240/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 13:11:20,161 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-19 13:11:20,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-19 13:11:20,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:20,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 13:11:20,170 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772280169"}]},"ts":"1689772280169"} 2023-07-19 13:11:20,172 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 13:11:20,175 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-19 13:11:20,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd94c5e16b69d854eed5de34e101955, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e31b11c6cb3a6b0d67a9ebcc04a2b300, UNASSIGN}] 2023-07-19 13:11:20,182 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd94c5e16b69d854eed5de34e101955, UNASSIGN 2023-07-19 13:11:20,182 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e31b11c6cb3a6b0d67a9ebcc04a2b300, UNASSIGN 2023-07-19 13:11:20,183 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e31b11c6cb3a6b0d67a9ebcc04a2b300, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:20,183 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8fd94c5e16b69d854eed5de34e101955, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:20,183 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772280183"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772280183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772280183"}]},"ts":"1689772280183"} 2023-07-19 13:11:20,183 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772280183"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772280183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772280183"}]},"ts":"1689772280183"} 2023-07-19 13:11:20,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure e31b11c6cb3a6b0d67a9ebcc04a2b300, server=jenkins-hbase4.apache.org,41603,1689772232926}] 2023-07-19 13:11:20,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 8fd94c5e16b69d854eed5de34e101955, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:11:20,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 13:11:20,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:20,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e31b11c6cb3a6b0d67a9ebcc04a2b300, disabling compactions & flushes 2023-07-19 13:11:20,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:20,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:20,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. after waiting 0 ms 2023-07-19 13:11:20,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:20,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:20,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8fd94c5e16b69d854eed5de34e101955, disabling compactions & flushes 2023-07-19 13:11:20,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:20,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:20,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. after waiting 0 ms 2023-07-19 13:11:20,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:20,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:11:20,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:20,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955. 2023-07-19 13:11:20,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8fd94c5e16b69d854eed5de34e101955: 2023-07-19 13:11:20,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:11:20,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:20,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300. 2023-07-19 13:11:20,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e31b11c6cb3a6b0d67a9ebcc04a2b300: 2023-07-19 13:11:20,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:20,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:20,382 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8fd94c5e16b69d854eed5de34e101955, regionState=CLOSED 2023-07-19 13:11:20,382 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772280382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772280382"}]},"ts":"1689772280382"} 2023-07-19 13:11:20,383 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e31b11c6cb3a6b0d67a9ebcc04a2b300, regionState=CLOSED 2023-07-19 13:11:20,384 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772280383"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772280383"}]},"ts":"1689772280383"} 2023-07-19 13:11:20,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-19 13:11:20,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 8fd94c5e16b69d854eed5de34e101955, server=jenkins-hbase4.apache.org,40427,1689772233020 in 197 msec 2023-07-19 13:11:20,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-19 13:11:20,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure e31b11c6cb3a6b0d67a9ebcc04a2b300, server=jenkins-hbase4.apache.org,41603,1689772232926 in 200 msec 2023-07-19 13:11:20,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8fd94c5e16b69d854eed5de34e101955, UNASSIGN in 209 msec 2023-07-19 13:11:20,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-19 13:11:20,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e31b11c6cb3a6b0d67a9ebcc04a2b300, UNASSIGN in 209 msec 2023-07-19 13:11:20,392 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772280392"}]},"ts":"1689772280392"} 2023-07-19 13:11:20,393 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 13:11:20,396 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-19 13:11:20,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 237 msec 2023-07-19 13:11:20,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 13:11:20,471 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-19 13:11:20,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-19 13:11:20,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:20,477 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:20,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-19 13:11:20,478 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:20,479 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-19 13:11:20,482 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:20,482 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:20,482 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:20,482 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:20,483 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 13:11:20,483 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 13:11:20,483 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 13:11:20,483 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 13:11:20,484 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:20,484 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:20,485 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:20,485 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:20,485 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:20,485 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:20,485 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:20,485 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:20,485 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:20,485 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:20,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 13:11:20,486 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/recovered.edits] 2023-07-19 13:11:20,486 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/recovered.edits] 2023-07-19 13:11:20,492 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/cf/335522ef3ee346868f0110271b5fb516 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/cf/335522ef3ee346868f0110271b5fb516 2023-07-19 13:11:20,492 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/cf/96ba42cc81cf40eeb63207a4193a0fdd to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/cf/96ba42cc81cf40eeb63207a4193a0fdd 2023-07-19 13:11:20,497 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/recovered.edits/9.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300/recovered.edits/9.seqid 2023-07-19 13:11:20,498 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/e31b11c6cb3a6b0d67a9ebcc04a2b300 2023-07-19 13:11:20,505 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/recovered.edits/9.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955/recovered.edits/9.seqid 2023-07-19 13:11:20,508 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemState/8fd94c5e16b69d854eed5de34e101955 2023-07-19 13:11:20,508 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 13:11:20,509 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-19 13:11:20,510 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-19 13:11:20,516 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719c4fe4bfb5ead4d5889d82f4c318f5b38 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719c4fe4bfb5ead4d5889d82f4c318f5b38 2023-07-19 13:11:20,517 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307193c46e20592eb41cca6eea616ef971742 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307193c46e20592eb41cca6eea616ef971742 2023-07-19 13:11:20,518 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-19 13:11:20,521 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:20,524 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-19 13:11:20,526 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-19 13:11:20,528 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:20,528 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-19 13:11:20,528 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772280528"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:20,528 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772280528"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:20,532 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 13:11:20,532 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8fd94c5e16b69d854eed5de34e101955, NAME => 'testtb-testExportFileSystemState,,1689772263580.8fd94c5e16b69d854eed5de34e101955.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e31b11c6cb3a6b0d67a9ebcc04a2b300, NAME => 'testtb-testExportFileSystemState,1,1689772263580.e31b11c6cb3a6b0d67a9ebcc04a2b300.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 13:11:20,533 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-19 13:11:20,533 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772280533"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:20,534 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-19 13:11:20,537 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:20,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 65 msec 2023-07-19 13:11:20,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 13:11:20,588 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-19 13:11:20,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-19 13:11:20,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:20,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-19 13:11:20,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-19 13:11:20,636 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 753) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:36300 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2028 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:46305 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:36896 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:52228 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1691254409_1 at /127.0.0.1:52204 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=334 (was 360), ProcessCount=183 (was 183), AvailableMemoryMB=3006 (was 3136) 2023-07-19 13:11:20,636 WARN [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-19 13:11:20,657 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=334, ProcessCount=183, AvailableMemoryMB=3006 2023-07-19 13:11:20,657 WARN [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-19 13:11:20,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 13:11:20,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:20,663 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:11:20,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-19 13:11:20,664 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:11:20,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 13:11:20,667 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:20,667 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:20,667 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb empty. 2023-07-19 13:11:20,667 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a empty. 2023-07-19 13:11:20,668 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:20,668 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:20,668 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 13:11:20,685 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-19 13:11:20,687 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 65ea7c2e9849ece6da018433da42c6cb, NAME => 'testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:11:20,687 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ce5d564adfee4fa3f4afca3a501e097a, NAME => 'testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:11:20,708 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:20,708 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ce5d564adfee4fa3f4afca3a501e097a, disabling compactions & flushes 2023-07-19 13:11:20,708 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:20,708 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:20,708 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. after waiting 0 ms 2023-07-19 13:11:20,708 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:20,708 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:20,708 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ce5d564adfee4fa3f4afca3a501e097a: 2023-07-19 13:11:20,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 13:11:20,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 13:11:21,108 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:21,108 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 65ea7c2e9849ece6da018433da42c6cb, disabling compactions & flushes 2023-07-19 13:11:21,108 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:21,108 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:21,108 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. after waiting 0 ms 2023-07-19 13:11:21,108 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:21,108 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:21,108 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 65ea7c2e9849ece6da018433da42c6cb: 2023-07-19 13:11:21,111 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:11:21,112 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772281112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772281112"}]},"ts":"1689772281112"} 2023-07-19 13:11:21,112 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772281112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772281112"}]},"ts":"1689772281112"} 2023-07-19 13:11:21,115 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:11:21,116 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:11:21,116 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772281116"}]},"ts":"1689772281116"} 2023-07-19 13:11:21,117 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-19 13:11:21,120 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:11:21,122 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:11:21,122 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:11:21,122 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:11:21,122 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:11:21,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ea7c2e9849ece6da018433da42c6cb, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce5d564adfee4fa3f4afca3a501e097a, ASSIGN}] 2023-07-19 13:11:21,127 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce5d564adfee4fa3f4afca3a501e097a, ASSIGN 2023-07-19 13:11:21,127 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ea7c2e9849ece6da018433da42c6cb, ASSIGN 2023-07-19 13:11:21,128 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce5d564adfee4fa3f4afca3a501e097a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40947,1689772233100; forceNewPlan=false, retain=false 2023-07-19 13:11:21,128 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ea7c2e9849ece6da018433da42c6cb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41603,1689772232926; forceNewPlan=false, retain=false 2023-07-19 13:11:21,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 13:11:21,278 INFO [jenkins-hbase4:33091] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:11:21,281 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=65ea7c2e9849ece6da018433da42c6cb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,281 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ce5d564adfee4fa3f4afca3a501e097a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,281 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772281281"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772281281"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772281281"}]},"ts":"1689772281281"} 2023-07-19 13:11:21,281 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772281281"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772281281"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772281281"}]},"ts":"1689772281281"} 2023-07-19 13:11:21,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 65ea7c2e9849ece6da018433da42c6cb, server=jenkins-hbase4.apache.org,41603,1689772232926}] 2023-07-19 13:11:21,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure ce5d564adfee4fa3f4afca3a501e097a, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:11:21,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:21,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 65ea7c2e9849ece6da018433da42c6cb, NAME => 'testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 13:11:21,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:21,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. service=AccessControlService 2023-07-19 13:11:21,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce5d564adfee4fa3f4afca3a501e097a, NAME => 'testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 13:11:21,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:21,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. service=AccessControlService 2023-07-19 13:11:21,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:21,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:21,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:21,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:21,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:21,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:21,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:21,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:21,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:21,444 INFO [StoreOpener-65ea7c2e9849ece6da018433da42c6cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:21,444 INFO [StoreOpener-ce5d564adfee4fa3f4afca3a501e097a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:21,445 DEBUG [StoreOpener-ce5d564adfee4fa3f4afca3a501e097a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/cf 2023-07-19 13:11:21,445 DEBUG [StoreOpener-ce5d564adfee4fa3f4afca3a501e097a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/cf 2023-07-19 13:11:21,445 DEBUG [StoreOpener-65ea7c2e9849ece6da018433da42c6cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/cf 2023-07-19 13:11:21,445 DEBUG [StoreOpener-65ea7c2e9849ece6da018433da42c6cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/cf 2023-07-19 13:11:21,446 INFO [StoreOpener-ce5d564adfee4fa3f4afca3a501e097a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce5d564adfee4fa3f4afca3a501e097a columnFamilyName cf 2023-07-19 13:11:21,446 INFO [StoreOpener-65ea7c2e9849ece6da018433da42c6cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 65ea7c2e9849ece6da018433da42c6cb columnFamilyName cf 2023-07-19 13:11:21,447 INFO [StoreOpener-ce5d564adfee4fa3f4afca3a501e097a-1] regionserver.HStore(310): Store=ce5d564adfee4fa3f4afca3a501e097a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:21,447 INFO [StoreOpener-65ea7c2e9849ece6da018433da42c6cb-1] regionserver.HStore(310): Store=65ea7c2e9849ece6da018433da42c6cb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:21,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:21,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:21,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:21,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:21,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:21,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:21,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:21,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 65ea7c2e9849ece6da018433da42c6cb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62280174, jitterRate=-0.07195308804512024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:21,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 65ea7c2e9849ece6da018433da42c6cb: 2023-07-19 13:11:21,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:21,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb., pid=45, masterSystemTime=1689772281435 2023-07-19 13:11:21,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ce5d564adfee4fa3f4afca3a501e097a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71209573, jitterRate=0.06110532581806183}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:21,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ce5d564adfee4fa3f4afca3a501e097a: 2023-07-19 13:11:21,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a., pid=46, masterSystemTime=1689772281435 2023-07-19 13:11:21,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:21,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:21,459 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=65ea7c2e9849ece6da018433da42c6cb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,459 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772281458"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772281458"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772281458"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772281458"}]},"ts":"1689772281458"} 2023-07-19 13:11:21,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:21,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:21,460 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ce5d564adfee4fa3f4afca3a501e097a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,461 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772281460"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772281460"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772281460"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772281460"}]},"ts":"1689772281460"} 2023-07-19 13:11:21,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-19 13:11:21,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 65ea7c2e9849ece6da018433da42c6cb, server=jenkins-hbase4.apache.org,41603,1689772232926 in 177 msec 2023-07-19 13:11:21,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-19 13:11:21,465 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ea7c2e9849ece6da018433da42c6cb, ASSIGN in 341 msec 2023-07-19 13:11:21,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure ce5d564adfee4fa3f4afca3a501e097a, server=jenkins-hbase4.apache.org,40947,1689772233100 in 179 msec 2023-07-19 13:11:21,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-19 13:11:21,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce5d564adfee4fa3f4afca3a501e097a, ASSIGN in 343 msec 2023-07-19 13:11:21,468 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:11:21,468 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772281468"}]},"ts":"1689772281468"} 2023-07-19 13:11:21,470 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-19 13:11:21,473 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:11:21,473 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-19 13:11:21,475 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 13:11:21,477 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:21,477 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:21,477 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:21,477 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:21,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:21,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:21,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:21,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:21,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 820 msec 2023-07-19 13:11:21,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 13:11:21,768 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-19 13:11:21,771 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 13:11:21,771 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:21,774 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:21,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 13:11:21,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772281785 (current time:1689772281785). 2023-07-19 13:11:21,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:21,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x423391fd to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:21,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b65a561, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:21,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:21,795 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:21,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x423391fd to 127.0.0.1:64840 2023-07-19 13:11:21,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:21,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x375dd1cb to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:21,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@693f12a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:21,803 DEBUG [hconnection-0x4fd7ec4f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:21,806 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:21,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x375dd1cb to 127.0.0.1:64840 2023-07-19 13:11:21,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:21,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 13:11:21,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:21,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 13:11:21,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 13:11:21,814 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 13:11:21,815 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689772881815 2023-07-19 13:11:21,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 13:11:21,815 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 13:11:21,816 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:21,816 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:21,818 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 13:11:21,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 13:11:21,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-19 13:11:21,820 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 13:11:21,821 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689772881821 2023-07-19 13:11:21,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,833 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-19 13:11:21,834 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:21,835 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 13:11:21,835 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 13:11:21,836 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,836 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,837 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:21,837 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:21,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:21,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:21,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:21,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:21,837 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,837 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:21,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:21,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:21,838 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,838 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,838 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,838 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:21,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 13:11:21,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 13:11:21,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 13:11:21,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 13:11:21,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 13:11:21,839 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 13:11:21,839 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:21,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 13:11:21,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,840 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 13:11:21,841 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 13:11:21,841 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,841 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:21,841 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 13:11:21,842 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 13:11:21,842 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 13:11:21,842 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 13:11:21,841 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 13:11:21,842 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:21,842 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 13:11:21,845 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 13:11:21,845 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 13:11:21,845 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 13:11:21,847 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,847 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:21,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:21,848 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,848 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,849 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,849 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,849 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,849 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:21,849 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:21,849 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,849 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:21,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:21,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:21,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:21,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:21,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 13:11:21,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fef4c9c[Count = 1] remaining members to acquire global barrier 2023-07-19 13:11:21,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:21,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:21,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:21,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:21,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:21,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:21,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 13:11:21,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fef4c9c[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:21,854 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 13:11:21,854 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,855 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,855 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,855 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 13:11:21,856 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 13:11:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 13:11:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:11:21,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,856 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 13:11:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:21,856 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. started... 2023-07-19 13:11:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:21,856 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:21,856 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:21,856 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,858 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:21,856 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. started... 2023-07-19 13:11:21,858 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ce5d564adfee4fa3f4afca3a501e097a: 2023-07-19 13:11:21,858 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 65ea7c2e9849ece6da018433da42c6cb: 2023-07-19 13:11:21,858 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,858 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:21,858 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:11:21,858 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,859 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:21,859 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:11:21,868 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 13:11:21,868 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:21,868 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 13:11:21,890 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. completed. 2023-07-19 13:11:21,890 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:21,890 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. completed. 2023-07-19 13:11:21,890 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:21,890 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:21,890 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,890 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:21,890 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 13:11:21,890 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:11:21,890 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:21,890 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:21,890 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,890 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 13:11:21,891 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:11:21,892 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,892 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 13:11:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:21,892 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:21,892 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 13:11:21,893 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 13:11:21,893 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:21,893 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:21,893 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 13:11:21,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:21,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:21,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41603,1689772232926': 2023-07-19 13:11:21,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 13:11:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:21,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:21,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40947,1689772233100': 2023-07-19 13:11:21,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 13:11:21,902 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-19 13:11:21,902 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:21,902 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:21,902 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,902 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:21,905 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,905 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,905 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:21,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:21,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,905 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:21,905 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,905 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:21,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,906 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:21,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:21,906 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:21,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:21,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:21,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:21,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:21,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:21,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:21,907 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,907 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:21,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:21,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,909 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:21,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:21,909 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,910 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:21,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,914 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:21,914 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:21,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:21,914 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,914 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,914 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:21,914 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:21,914 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:21,914 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:21,914 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:21,914 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:21,914 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:21,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:21,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:21,914 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:21,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:21,914 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-19 13:11:21,915 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 13:11:21,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:21,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:21,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:21,915 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:21,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:21,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:21,917 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:21,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:21,917 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 13:11:21,918 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:21,918 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:21,918 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,918 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 13:11:21,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:21,919 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:21,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 13:11:21,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,969 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:21,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689772281815Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689772281927 (+112 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689772281927Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689772281927Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689772281931 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689772281942 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689772281968 (+26 ms) 2023-07-19 13:11:21,972 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 13:11:21,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 156 msec 2023-07-19 13:11:22,119 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:22,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 13:11:22,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:22,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41603] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:11:22,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40947] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:11:22,130 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 13:11:22,130 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:22,130 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:22,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 13:11:22,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772282143 (current time:1689772282143). 2023-07-19 13:11:22,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:22,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x0e0e26c9 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:22,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41030eae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:22,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:22,158 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:22,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e0e26c9 to 127.0.0.1:64840 2023-07-19 13:11:22,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:22,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x182b61f5 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:22,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67ec3457, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:22,167 DEBUG [hconnection-0x3e43207a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:22,168 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:22,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x182b61f5 to 127.0.0.1:64840 2023-07-19 13:11:22,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:22,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 13:11:22,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:22,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 13:11:22,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 13:11:22,177 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 13:11:22,178 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689772882178 2023-07-19 13:11:22,178 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 13:11:22,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 13:11:22,179 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:22,180 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:22,181 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 13:11:22,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 13:11:22,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-19 13:11:22,182 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 13:11:22,183 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689772882183 2023-07-19 13:11:22,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-19 13:11:22,193 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-19 13:11:22,193 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:22,194 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 13:11:22,194 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 13:11:22,194 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,194 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,196 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:22,196 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:22,196 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:22,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:22,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:22,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:22,196 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,197 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,197 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:22,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:22,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:22,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 13:11:22,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,198 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 13:11:22,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 13:11:22,198 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 13:11:22,199 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:22,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 13:11:22,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,200 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 13:11:22,200 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 13:11:22,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,200 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 13:11:22,200 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 13:11:22,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 13:11:22,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,200 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 13:11:22,202 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,202 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,202 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:22,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 13:11:22,203 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 13:11:22,203 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:22,206 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 13:11:22,206 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 13:11:22,206 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 13:11:22,206 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,206 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,207 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:22,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,207 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 13:11:22,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:22,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:22,207 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 13:11:22,207 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:22,208 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 13:11:22,208 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 13:11:22,208 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 13:11:22,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:22,210 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,210 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:22,211 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,211 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,212 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:22,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:22,212 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,212 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:22,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:22,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:22,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 13:11:22,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22ef1f31[Count = 1] remaining members to acquire global barrier 2023-07-19 13:11:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:22,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:22,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 13:11:22,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22ef1f31[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:22,218 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 13:11:22,218 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,219 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,219 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,219 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,219 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 13:11:22,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,220 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 13:11:22,220 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 13:11:22,220 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,220 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 13:11:22,220 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:11:22,220 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,220 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:22,222 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 13:11:22,222 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:22,222 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 13:11:22,229 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:22,229 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:22,229 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:22,229 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. started... 2023-07-19 13:11:22,230 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ce5d564adfee4fa3f4afca3a501e097a 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 13:11:22,234 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:22,234 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:22,234 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:22,234 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. started... 2023-07-19 13:11:22,234 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 65ea7c2e9849ece6da018433da42c6cb 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 13:11:22,274 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307196bbce352ae8c4dcfb22ac8ef425d78e4 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307196bbce352ae8c4dcfb22ac8ef425d78e4 2023-07-19 13:11:22,280 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:22,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 13:11:22,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:22,281 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:22,290 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071902531393035e424d842a59580c23fa0c to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071902531393035e424d842a59580c23fa0c 2023-07-19 13:11:22,292 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/.tmp/cf/d0f32e575a5b4f1081817b3b0ab150a6 2023-07-19 13:11:22,298 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/.tmp/cf/d0f32e575a5b4f1081817b3b0ab150a6 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/cf/d0f32e575a5b4f1081817b3b0ab150a6 2023-07-19 13:11:22,302 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/.tmp/cf/1aa6695db03f4f6096b57647be5b6846 2023-07-19 13:11:22,304 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/cf/d0f32e575a5b4f1081817b3b0ab150a6, entries=5, sequenceid=6, filesize=5.7 K 2023-07-19 13:11:22,305 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 65ea7c2e9849ece6da018433da42c6cb in 71ms, sequenceid=6, compaction requested=false 2023-07-19 13:11:22,306 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 13:11:22,306 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 65ea7c2e9849ece6da018433da42c6cb: 2023-07-19 13:11:22,307 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 13:11:22,307 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:22,307 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/cf/d0f32e575a5b4f1081817b3b0ab150a6] hfiles 2023-07-19 13:11:22,307 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/cf/d0f32e575a5b4f1081817b3b0ab150a6 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 13:11:22,308 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/.tmp/cf/1aa6695db03f4f6096b57647be5b6846 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/cf/1aa6695db03f4f6096b57647be5b6846 2023-07-19 13:11:22,314 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/cf/1aa6695db03f4f6096b57647be5b6846, entries=45, sequenceid=6, filesize=12.4 K 2023-07-19 13:11:22,315 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for ce5d564adfee4fa3f4afca3a501e097a in 86ms, sequenceid=6, compaction requested=false 2023-07-19 13:11:22,317 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ce5d564adfee4fa3f4afca3a501e097a: 2023-07-19 13:11:22,317 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 13:11:22,317 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:22,317 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/cf/1aa6695db03f4f6096b57647be5b6846] hfiles 2023-07-19 13:11:22,317 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/cf/1aa6695db03f4f6096b57647be5b6846 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 13:11:22,318 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. completed. 2023-07-19 13:11:22,319 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:22,319 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:22,319 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:22,319 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,322 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 13:11:22,322 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:11:22,324 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,324 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 13:11:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:22,324 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:22,324 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 13:11:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:22,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:22,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:22,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41603,1689772232926': 2023-07-19 13:11:22,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 13:11:22,333 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. completed. 2023-07-19 13:11:22,333 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:22,333 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:22,333 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:22,333 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,333 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 13:11:22,333 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:11:22,335 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,335 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 13:11:22,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:22,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:22,336 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:22,336 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 13:11:22,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:22,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:22,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:22,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:22,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40947,1689772233100': 2023-07-19 13:11:22,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 13:11:22,341 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-19 13:11:22,341 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:22,341 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:22,341 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-19 13:11:22,341 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:22,342 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,342 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:22,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,342 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:22,342 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,342 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,343 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,343 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,343 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:22,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:22,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:22,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:22,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:22,344 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,344 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:22,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:22,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:22,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,346 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:22,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:22,347 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:22,347 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:22,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,353 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,353 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:22,353 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:22,354 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:22,354 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:22,354 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-19 13:11:22,353 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:22,354 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-19 13:11:22,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 13:11:22,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:22,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:22,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 13:11:22,354 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:22,354 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:22,354 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:22,354 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:22,356 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:22,355 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:22,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:22,356 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:22,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:22,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:22,357 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071902531393035e424d842a59580c23fa0c, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307196bbce352ae8c4dcfb22ac8ef425d78e4] mob files 2023-07-19 13:11:22,357 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:22,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071902531393035e424d842a59580c23fa0c 2023-07-19 13:11:22,357 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:22,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307196bbce352ae8c4dcfb22ac8ef425d78e4 2023-07-19 13:11:22,357 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,357 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:22,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:22,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-19 13:11:22,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,411 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 13:11:22,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,412 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689772282178Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689772282369 (+191 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689772282369Loading Region manifests for snaptb0-testConsecutiveExports at 1689772282369Writing data manifest for snaptb0-testConsecutiveExports at 1689772282373 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689772282384 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689772282411 (+27 ms) 2023-07-19 13:11:22,415 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 13:11:22,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 236 msec 2023-07-19 13:11:22,481 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:22,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 13:11:22,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:22,483 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483 2023-07-19 13:11:22,483 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483, srcFsUri=hdfs://localhost:42143, srcDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:11:22,506 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:11:22,506 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5b2e25ff, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,506 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5, snapshotDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 13:11:22,515 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:22,539 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:22,539 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:22,540 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:22,540 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:23,488 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-7565028366991966238.jar 2023-07-19 13:11:23,488 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:23,488 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:23,559 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-5490852808168579701.jar 2023-07-19 13:11:23,559 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:23,560 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:23,561 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:23,561 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:23,562 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:23,562 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:23,563 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:11:23,563 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:11:23,564 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:11:23,564 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:11:23,564 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:11:23,565 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:11:23,565 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:11:23,565 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:11:23,566 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:11:23,566 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:11:23,567 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:23,567 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:23,568 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:23,568 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:23,568 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:23,569 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:23,569 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:24,423 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0002_000001 (auth:SIMPLE) 2023-07-19 13:11:25,019 WARN [Listener at jenkins-hbase4.apache.org/36809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:11:25,021 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 13:11:25,024 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-19 13:11:25,094 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:25,094 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:25,432 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0003_000001 (auth:SIMPLE) 2023-07-19 13:11:25,983 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:11:29,909 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0003_000001 (auth:SIMPLE) 2023-07-19 13:11:32,143 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0003_000001 (auth:SIMPLE) 2023-07-19 13:11:34,472 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0003_000001 (auth:SIMPLE) 2023-07-19 13:11:36,255 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:11:36,255 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:11:36,260 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 13:11:36,260 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:11:36,261 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:11:36,261 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583241713_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 13:11:36,263 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 13:11:36,263 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 13:11:36,263 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@25299694 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 13:11:36,264 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 13:11:36,264 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 13:11:36,265 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483, srcFsUri=hdfs://localhost:42143, srcDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:11:36,287 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:11:36,287 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@215382df, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:36,287 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5, snapshotDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 13:11:36,299 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:36,310 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:36,311 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:36,311 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:36,311 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:37,192 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-6131440436112765369.jar 2023-07-19 13:11:37,192 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:37,193 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:37,259 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-2159158938567811460.jar 2023-07-19 13:11:37,260 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:37,260 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:37,261 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:37,261 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:37,261 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:37,262 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:37,262 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:11:37,263 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:11:37,263 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:11:37,263 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:11:37,264 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:11:37,264 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:11:37,265 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:11:37,265 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:11:37,265 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:11:37,266 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:11:37,266 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:37,267 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:37,267 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:37,268 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:37,268 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:37,268 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:37,269 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:37,670 WARN [Listener at jenkins-hbase4.apache.org/36809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:11:37,674 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 13:11:37,676 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-19 13:11:40,644 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:40,644 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:40,647 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0003_000001 (auth:SIMPLE) 2023-07-19 13:11:40,858 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0004_000001 (auth:SIMPLE) 2023-07-19 13:11:45,492 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0004_000001 (auth:SIMPLE) 2023-07-19 13:11:47,763 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0004_000001 (auth:SIMPLE) 2023-07-19 13:11:52,417 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0004_000001 (auth:SIMPLE) 2023-07-19 13:11:53,911 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:11:53,912 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:11:53,919 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 13:11:53,920 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:11:53,920 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:11:53,920 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583241713_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 13:11:53,928 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 13:11:53,928 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 13:11:53,928 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@25299694 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 13:11:53,928 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 13:11:53,928 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/local-export-1689772282483/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 13:11:53,944 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-19 13:11:53,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-19 13:11:53,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:53,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 13:11:53,956 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772313956"}]},"ts":"1689772313956"} 2023-07-19 13:11:53,958 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-19 13:11:53,960 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-19 13:11:53,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ea7c2e9849ece6da018433da42c6cb, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce5d564adfee4fa3f4afca3a501e097a, UNASSIGN}] 2023-07-19 13:11:53,964 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ea7c2e9849ece6da018433da42c6cb, UNASSIGN 2023-07-19 13:11:53,964 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce5d564adfee4fa3f4afca3a501e097a, UNASSIGN 2023-07-19 13:11:53,965 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ce5d564adfee4fa3f4afca3a501e097a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:53,965 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=65ea7c2e9849ece6da018433da42c6cb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:53,965 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772313965"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772313965"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772313965"}]},"ts":"1689772313965"} 2023-07-19 13:11:53,965 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772313965"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772313965"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772313965"}]},"ts":"1689772313965"} 2023-07-19 13:11:53,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure ce5d564adfee4fa3f4afca3a501e097a, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:11:53,968 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 65ea7c2e9849ece6da018433da42c6cb, server=jenkins-hbase4.apache.org,41603,1689772232926}] 2023-07-19 13:11:54,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 13:11:54,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:54,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ce5d564adfee4fa3f4afca3a501e097a, disabling compactions & flushes 2023-07-19 13:11:54,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:54,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:54,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. after waiting 0 ms 2023-07-19 13:11:54,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:54,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:54,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 65ea7c2e9849ece6da018433da42c6cb, disabling compactions & flushes 2023-07-19 13:11:54,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:54,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:54,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. after waiting 0 ms 2023-07-19 13:11:54,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:54,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:11:54,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:11:54,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:54,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb. 2023-07-19 13:11:54,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 65ea7c2e9849ece6da018433da42c6cb: 2023-07-19 13:11:54,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:54,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a. 2023-07-19 13:11:54,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ce5d564adfee4fa3f4afca3a501e097a: 2023-07-19 13:11:54,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:54,163 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=65ea7c2e9849ece6da018433da42c6cb, regionState=CLOSED 2023-07-19 13:11:54,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:54,164 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772314163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772314163"}]},"ts":"1689772314163"} 2023-07-19 13:11:54,165 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ce5d564adfee4fa3f4afca3a501e097a, regionState=CLOSED 2023-07-19 13:11:54,165 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772314165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772314165"}]},"ts":"1689772314165"} 2023-07-19 13:11:54,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-19 13:11:54,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 65ea7c2e9849ece6da018433da42c6cb, server=jenkins-hbase4.apache.org,41603,1689772232926 in 197 msec 2023-07-19 13:11:54,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-19 13:11:54,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure ce5d564adfee4fa3f4afca3a501e097a, server=jenkins-hbase4.apache.org,40947,1689772233100 in 201 msec 2023-07-19 13:11:54,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=65ea7c2e9849ece6da018433da42c6cb, UNASSIGN in 213 msec 2023-07-19 13:11:54,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-19 13:11:54,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce5d564adfee4fa3f4afca3a501e097a, UNASSIGN in 216 msec 2023-07-19 13:11:54,180 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772314180"}]},"ts":"1689772314180"} 2023-07-19 13:11:54,183 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-19 13:11:54,185 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-19 13:11:54,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 240 msec 2023-07-19 13:11:54,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 13:11:54,259 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-19 13:11:54,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-19 13:11:54,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:54,265 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:54,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-19 13:11:54,268 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-19 13:11:54,269 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:54,274 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:54,274 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:54,274 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:54,274 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:54,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 13:11:54,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 13:11:54,275 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 13:11:54,277 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:54,278 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:54,278 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:54,278 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:54,277 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:54,278 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:54,278 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:54,278 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-19 13:11:54,278 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:11:54,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 13:11:54,280 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:54,280 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:54,283 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/recovered.edits] 2023-07-19 13:11:54,287 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/recovered.edits] 2023-07-19 13:11:54,296 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/cf/d0f32e575a5b4f1081817b3b0ab150a6 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/cf/d0f32e575a5b4f1081817b3b0ab150a6 2023-07-19 13:11:54,309 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/cf/1aa6695db03f4f6096b57647be5b6846 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/cf/1aa6695db03f4f6096b57647be5b6846 2023-07-19 13:11:54,309 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/recovered.edits/9.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb/recovered.edits/9.seqid 2023-07-19 13:11:54,316 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/65ea7c2e9849ece6da018433da42c6cb 2023-07-19 13:11:54,319 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/recovered.edits/9.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a/recovered.edits/9.seqid 2023-07-19 13:11:54,320 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testConsecutiveExports/ce5d564adfee4fa3f4afca3a501e097a 2023-07-19 13:11:54,320 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 13:11:54,320 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-19 13:11:54,321 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-19 13:11:54,329 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071902531393035e424d842a59580c23fa0c to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071902531393035e424d842a59580c23fa0c 2023-07-19 13:11:54,332 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307196bbce352ae8c4dcfb22ac8ef425d78e4 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307196bbce352ae8c4dcfb22ac8ef425d78e4 2023-07-19 13:11:54,333 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-19 13:11:54,337 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:54,350 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-19 13:11:54,353 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-19 13:11:54,359 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:54,360 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-19 13:11:54,360 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772314360"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:54,360 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772314360"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:54,367 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 13:11:54,367 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 65ea7c2e9849ece6da018433da42c6cb, NAME => 'testtb-testConsecutiveExports,,1689772280659.65ea7c2e9849ece6da018433da42c6cb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ce5d564adfee4fa3f4afca3a501e097a, NAME => 'testtb-testConsecutiveExports,1,1689772280659.ce5d564adfee4fa3f4afca3a501e097a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 13:11:54,367 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-19 13:11:54,367 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772314367"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:54,371 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-19 13:11:54,375 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:54,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 114 msec 2023-07-19 13:11:54,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 13:11:54,382 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-19 13:11:54,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-19 13:11:54,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:54,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-19 13:11:54,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-19 13:11:54,453 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 766), OpenFileDescriptor=900 (was 915), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=357 (was 334) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2738 (was 3006) 2023-07-19 13:11:54,453 WARN [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-19 13:11:54,486 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=357, ProcessCount=185, AvailableMemoryMB=2737 2023-07-19 13:11:54,486 WARN [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-19 13:11:54,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 13:11:54,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:54,492 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:11:54,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-19 13:11:54,494 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:11:54,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 13:11:54,497 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:11:54,497 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:11:54,498 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1 empty. 2023-07-19 13:11:54,498 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1 empty. 2023-07-19 13:11:54,498 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:11:54,499 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:11:54,499 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 13:11:54,518 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-19 13:11:54,519 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 71ca3bbc5083cfdb4003e39dad89e3d1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:11:54,520 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0a5da6a0e9001cc546b01f265aeaf3b1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:11:54,559 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:54,559 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 71ca3bbc5083cfdb4003e39dad89e3d1, disabling compactions & flushes 2023-07-19 13:11:54,559 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:54,559 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:54,559 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. after waiting 0 ms 2023-07-19 13:11:54,559 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:54,559 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:54,559 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 71ca3bbc5083cfdb4003e39dad89e3d1: 2023-07-19 13:11:54,566 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:54,566 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 0a5da6a0e9001cc546b01f265aeaf3b1, disabling compactions & flushes 2023-07-19 13:11:54,567 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:11:54,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:11:54,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. after waiting 0 ms 2023-07-19 13:11:54,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:11:54,567 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:11:54,567 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 0a5da6a0e9001cc546b01f265aeaf3b1: 2023-07-19 13:11:54,571 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:11:54,572 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772314572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772314572"}]},"ts":"1689772314572"} 2023-07-19 13:11:54,572 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772314572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772314572"}]},"ts":"1689772314572"} 2023-07-19 13:11:54,581 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:11:54,582 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:11:54,583 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772314582"}]},"ts":"1689772314582"} 2023-07-19 13:11:54,586 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-19 13:11:54,603 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:11:54,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 13:11:54,605 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:11:54,605 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:11:54,605 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:11:54,605 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:11:54,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71ca3bbc5083cfdb4003e39dad89e3d1, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a5da6a0e9001cc546b01f265aeaf3b1, ASSIGN}] 2023-07-19 13:11:54,617 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a5da6a0e9001cc546b01f265aeaf3b1, ASSIGN 2023-07-19 13:11:54,617 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71ca3bbc5083cfdb4003e39dad89e3d1, ASSIGN 2023-07-19 13:11:54,619 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71ca3bbc5083cfdb4003e39dad89e3d1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40427,1689772233020; forceNewPlan=false, retain=false 2023-07-19 13:11:54,619 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a5da6a0e9001cc546b01f265aeaf3b1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40947,1689772233100; forceNewPlan=false, retain=false 2023-07-19 13:11:54,769 INFO [jenkins-hbase4:33091] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:11:54,772 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0a5da6a0e9001cc546b01f265aeaf3b1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:54,772 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=71ca3bbc5083cfdb4003e39dad89e3d1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:54,772 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772314772"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772314772"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772314772"}]},"ts":"1689772314772"} 2023-07-19 13:11:54,772 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772314772"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772314772"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772314772"}]},"ts":"1689772314772"} 2023-07-19 13:11:54,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 0a5da6a0e9001cc546b01f265aeaf3b1, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:11:54,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 71ca3bbc5083cfdb4003e39dad89e3d1, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:11:54,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 13:11:54,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:54,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 71ca3bbc5083cfdb4003e39dad89e3d1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 13:11:54,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. service=AccessControlService 2023-07-19 13:11:54,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:54,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:11:54,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:54,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:11:54,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:11:54,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:11:54,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a5da6a0e9001cc546b01f265aeaf3b1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 13:11:54,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. service=AccessControlService 2023-07-19 13:11:54,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:54,939 INFO [StoreOpener-71ca3bbc5083cfdb4003e39dad89e3d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:11:54,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:11:54,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:54,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:11:54,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:11:54,940 INFO [StoreOpener-0a5da6a0e9001cc546b01f265aeaf3b1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:11:54,941 DEBUG [StoreOpener-71ca3bbc5083cfdb4003e39dad89e3d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/cf 2023-07-19 13:11:54,941 DEBUG [StoreOpener-71ca3bbc5083cfdb4003e39dad89e3d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/cf 2023-07-19 13:11:54,942 INFO [StoreOpener-71ca3bbc5083cfdb4003e39dad89e3d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 71ca3bbc5083cfdb4003e39dad89e3d1 columnFamilyName cf 2023-07-19 13:11:54,944 DEBUG [StoreOpener-0a5da6a0e9001cc546b01f265aeaf3b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/cf 2023-07-19 13:11:54,944 INFO [StoreOpener-71ca3bbc5083cfdb4003e39dad89e3d1-1] regionserver.HStore(310): Store=71ca3bbc5083cfdb4003e39dad89e3d1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:54,944 DEBUG [StoreOpener-0a5da6a0e9001cc546b01f265aeaf3b1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/cf 2023-07-19 13:11:54,944 INFO [StoreOpener-0a5da6a0e9001cc546b01f265aeaf3b1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a5da6a0e9001cc546b01f265aeaf3b1 columnFamilyName cf 2023-07-19 13:11:54,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:11:54,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:11:54,946 INFO [StoreOpener-0a5da6a0e9001cc546b01f265aeaf3b1-1] regionserver.HStore(310): Store=0a5da6a0e9001cc546b01f265aeaf3b1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:54,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:11:54,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:11:54,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:11:54,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:54,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:11:54,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 71ca3bbc5083cfdb4003e39dad89e3d1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60298875, jitterRate=-0.1014767438173294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:54,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 71ca3bbc5083cfdb4003e39dad89e3d1: 2023-07-19 13:11:54,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1., pid=61, masterSystemTime=1689772314929 2023-07-19 13:11:54,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:54,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a5da6a0e9001cc546b01f265aeaf3b1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60018849, jitterRate=-0.10564945638179779}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:54,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a5da6a0e9001cc546b01f265aeaf3b1: 2023-07-19 13:11:54,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:54,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:54,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1., pid=60, masterSystemTime=1689772314928 2023-07-19 13:11:54,964 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=71ca3bbc5083cfdb4003e39dad89e3d1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:54,964 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772314964"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772314964"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772314964"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772314964"}]},"ts":"1689772314964"} 2023-07-19 13:11:54,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:11:54,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:11:54,968 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0a5da6a0e9001cc546b01f265aeaf3b1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:54,968 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772314968"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772314968"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772314968"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772314968"}]},"ts":"1689772314968"} 2023-07-19 13:11:54,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-19 13:11:54,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 71ca3bbc5083cfdb4003e39dad89e3d1, server=jenkins-hbase4.apache.org,40427,1689772233020 in 190 msec 2023-07-19 13:11:54,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71ca3bbc5083cfdb4003e39dad89e3d1, ASSIGN in 364 msec 2023-07-19 13:11:54,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-19 13:11:54,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 0a5da6a0e9001cc546b01f265aeaf3b1, server=jenkins-hbase4.apache.org,40947,1689772233100 in 196 msec 2023-07-19 13:11:54,974 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-19 13:11:54,974 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a5da6a0e9001cc546b01f265aeaf3b1, ASSIGN in 366 msec 2023-07-19 13:11:54,977 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:11:54,977 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772314977"}]},"ts":"1689772314977"} 2023-07-19 13:11:54,979 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-19 13:11:54,981 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:11:54,982 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-19 13:11:54,984 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 13:11:54,985 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:54,985 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:54,985 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:54,985 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:54,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:54,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:54,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:54,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:54,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 499 msec 2023-07-19 13:11:55,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 13:11:55,107 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-19 13:11:55,110 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,110 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:55,112 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:55,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 13:11:55,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772315129 (current time:1689772315129). 2023-07-19 13:11:55,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:55,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x73f04dbb to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:55,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f6a1cce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:55,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:55,144 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:55,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73f04dbb to 127.0.0.1:64840 2023-07-19 13:11:55,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:55,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x6d091f52 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:55,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12e7d31a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:55,161 DEBUG [hconnection-0x56ea69c4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:55,165 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:55,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d091f52 to 127.0.0.1:64840 2023-07-19 13:11:55,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:55,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 13:11:55,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:55,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 13:11:55,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 13:11:55,179 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 13:11:55,180 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689772915179 2023-07-19 13:11:55,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 13:11:55,180 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,181 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:55,181 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:55,183 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 13:11:55,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 13:11:55,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-19 13:11:55,186 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 13:11:55,187 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689772915187 2023-07-19 13:11:55,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,209 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 13:11:55,210 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:55,211 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 13:11:55,211 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 13:11:55,211 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,211 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,213 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,214 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:55,214 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:55,214 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:55,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:55,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:55,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:55,214 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,214 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:55,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:55,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:55,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,214 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,215 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,215 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 13:11:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 13:11:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 13:11:55,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 13:11:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 13:11:55,216 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 13:11:55,216 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,216 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 13:11:55,216 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:55,216 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,216 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,219 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 13:11:55,220 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 13:11:55,220 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 13:11:55,220 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 13:11:55,220 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 13:11:55,220 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:55,220 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:55,224 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 13:11:55,224 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 13:11:55,224 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 13:11:55,229 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,229 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:55,229 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,229 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,229 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,229 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:55,230 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,230 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:55,230 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 13:11:55,230 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 13:11:55,230 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 13:11:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,232 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,233 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,233 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:55,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:55,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 13:11:55,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12724492[Count = 1] remaining members to acquire global barrier 2023-07-19 13:11:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:55,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 13:11:55,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12724492[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:55,240 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 13:11:55,241 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,242 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,242 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,242 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,242 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 13:11:55,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,242 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 13:11:55,242 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,242 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:11:55,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,242 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 13:11:55,243 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,243 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:55,243 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 13:11:55,243 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:55,243 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:55,243 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:55,243 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:55,243 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. started... 2023-07-19 13:11:55,243 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:55,243 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:11:55,243 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. started... 2023-07-19 13:11:55,243 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 71ca3bbc5083cfdb4003e39dad89e3d1: 2023-07-19 13:11:55,245 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a5da6a0e9001cc546b01f265aeaf3b1: 2023-07-19 13:11:55,245 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,245 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,245 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:55,245 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:55,245 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:11:55,245 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:11:55,253 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 13:11:55,253 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:55,253 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 13:11:55,274 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. completed. 2023-07-19 13:11:55,274 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:11:55,274 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:55,274 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:55,274 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,274 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 13:11:55,274 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:11:55,275 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. completed. 2023-07-19 13:11:55,275 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:55,275 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:55,275 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:55,276 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,276 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 13:11:55,276 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:11:55,276 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 13:11:55,276 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:55,276 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,276 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 13:11:55,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:55,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:55,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:55,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:55,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,280 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 13:11:55,280 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,280 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:55,280 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 13:11:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,282 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 13:11:55,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:55,283 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40947,1689772233100': 2023-07-19 13:11:55,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 13:11:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:55,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40427,1689772233020': 2023-07-19 13:11:55,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 13:11:55,288 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 13:11:55,288 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:55,288 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:55,288 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,288 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:55,290 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,290 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:55,290 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,290 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,291 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:55,290 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:55,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,290 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,291 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:55,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:55,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:55,291 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,292 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,295 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,295 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,296 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,300 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,300 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:55,300 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:55,301 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,301 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,301 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:55,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:55,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:55,301 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,301 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:55,301 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:55,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:55,301 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,301 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:55,301 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:55,301 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,303 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,303 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,303 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,303 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,303 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,303 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:55,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:55,301 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 13:11:55,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:55,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:55,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 13:11:55,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 13:11:55,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,360 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689772315180Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689772315313 (+133 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689772315313Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689772315313Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689772315317 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689772315325 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689772315359 (+34 ms) 2023-07-19 13:11:55,363 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 13:11:55,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 182 msec 2023-07-19 13:11:55,483 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:55,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 13:11:55,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:55,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40427] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:11:55,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40947] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:11:55,492 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,492 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:55,493 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:55,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 13:11:55,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772315504 (current time:1689772315504). 2023-07-19 13:11:55,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:55,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x0f0c0b95 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:55,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bf9d0bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:55,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:55,512 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:55,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f0c0b95 to 127.0.0.1:64840 2023-07-19 13:11:55,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:55,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x7c5b17e8 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:55,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1364eb55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:55,521 DEBUG [hconnection-0x161da5b5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:55,523 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:55,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c5b17e8 to 127.0.0.1:64840 2023-07-19 13:11:55,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:55,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 13:11:55,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:55,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 13:11:55,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 13:11:55,531 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 13:11:55,532 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689772915532 2023-07-19 13:11:55,532 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 13:11:55,533 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:55,533 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:55,534 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 13:11:55,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 13:11:55,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-19 13:11:55,536 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 13:11:55,537 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689772915537 2023-07-19 13:11:55,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,547 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 13:11:55,547 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:55,548 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 13:11:55,548 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 13:11:55,549 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,549 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,550 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:55,550 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:55,550 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:55,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:55,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:55,550 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:55,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:55,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:55,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:55,551 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,551 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,551 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,551 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:55,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 13:11:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 13:11:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 13:11:55,552 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 13:11:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,552 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 13:11:55,552 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 13:11:55,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,552 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 13:11:55,553 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 13:11:55,553 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,553 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:55,553 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 13:11:55,553 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:55,553 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:55,554 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 13:11:55,555 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 13:11:55,554 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 13:11:55,555 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 13:11:55,555 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 13:11:55,555 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 13:11:55,555 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 13:11:55,555 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 13:11:55,556 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 13:11:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,557 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:55,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:55,558 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:55,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,558 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:55,559 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,559 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:55,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 13:11:55,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b1315f6[Count = 1] remaining members to acquire global barrier 2023-07-19 13:11:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:55,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 13:11:55,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b1315f6[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:55,563 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 13:11:55,563 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,565 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,565 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,565 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,565 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,565 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 13:11:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,566 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 13:11:55,566 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 13:11:55,566 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:55,566 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:55,566 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,566 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:55,566 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:55,566 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:55,566 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 13:11:55,566 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. started... 2023-07-19 13:11:55,566 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:11:55,566 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:55,566 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:11:55,566 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 71ca3bbc5083cfdb4003e39dad89e3d1 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-19 13:11:55,566 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. started... 2023-07-19 13:11:55,567 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0a5da6a0e9001cc546b01f265aeaf3b1 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-19 13:11:55,568 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 13:11:55,568 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:55,568 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 13:11:55,597 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307193e4c093c20de465e94e6ed893d391300 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307193e4c093c20de465e94e6ed893d391300 2023-07-19 13:11:55,598 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719daba88561f3c4c2098d9a201b4ff70c8 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719daba88561f3c4c2098d9a201b4ff70c8 2023-07-19 13:11:55,607 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/.tmp/cf/94a2eeb3181d45fe9f9e765c06c3d533 2023-07-19 13:11:55,614 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/.tmp/cf/94a2eeb3181d45fe9f9e765c06c3d533 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/cf/94a2eeb3181d45fe9f9e765c06c3d533 2023-07-19 13:11:55,620 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/cf/94a2eeb3181d45fe9f9e765c06c3d533, entries=6, sequenceid=6, filesize=6.0 K 2023-07-19 13:11:55,621 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 71ca3bbc5083cfdb4003e39dad89e3d1 in 55ms, sequenceid=6, compaction requested=false 2023-07-19 13:11:55,621 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 13:11:55,622 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 71ca3bbc5083cfdb4003e39dad89e3d1: 2023-07-19 13:11:55,622 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,622 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:55,622 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/cf/94a2eeb3181d45fe9f9e765c06c3d533] hfiles 2023-07-19 13:11:55,622 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/cf/94a2eeb3181d45fe9f9e765c06c3d533 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,629 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/.tmp/cf/af785dc491c64e93940d2b433182ffd5 2023-07-19 13:11:55,633 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:55,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 13:11:55,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:55,635 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:55,636 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/.tmp/cf/af785dc491c64e93940d2b433182ffd5 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/cf/af785dc491c64e93940d2b433182ffd5 2023-07-19 13:11:55,645 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/cf/af785dc491c64e93940d2b433182ffd5, entries=44, sequenceid=6, filesize=13.0 K 2023-07-19 13:11:55,654 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 0a5da6a0e9001cc546b01f265aeaf3b1 in 87ms, sequenceid=6, compaction requested=false 2023-07-19 13:11:55,656 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a5da6a0e9001cc546b01f265aeaf3b1: 2023-07-19 13:11:55,656 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,656 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:55,656 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/cf/af785dc491c64e93940d2b433182ffd5] hfiles 2023-07-19 13:11:55,656 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/cf/af785dc491c64e93940d2b433182ffd5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,658 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. completed. 2023-07-19 13:11:55,658 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:11:55,658 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:55,658 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:55,658 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,658 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 13:11:55,658 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:11:55,660 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,660 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 13:11:55,660 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:55,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,660 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 13:11:55,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:55,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:55,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:55,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:55,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:55,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40427,1689772233020': 2023-07-19 13:11:55,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 13:11:55,673 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. completed. 2023-07-19 13:11:55,673 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:11:55,673 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:55,673 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:55,673 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,673 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 13:11:55,673 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:11:55,676 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,676 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 13:11:55,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:55,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:55,676 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:55,676 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 13:11:55,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:55,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:55,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:55,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40947,1689772233100': 2023-07-19 13:11:55,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 13:11:55,681 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 13:11:55,681 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:55,681 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:55,681 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,681 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:55,687 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,687 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,687 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:55,687 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,687 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,688 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,688 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:55,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:55,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:55,688 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:55,689 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,690 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,692 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,692 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,692 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,695 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,695 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:55,695 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:55,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:55,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:55,696 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:55,696 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:55,696 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:55,697 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,695 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:55,695 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:55,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,697 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:55,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 13:11:55,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:55,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:55,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:55,696 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:55,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:55,698 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,698 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,698 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,698 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:55,698 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,698 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:55,698 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:55,698 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,699 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719daba88561f3c4c2098d9a201b4ff70c8, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307193e4c093c20de465e94e6ed893d391300] mob files 2023-07-19 13:11:55,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:55,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:55,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719daba88561f3c4c2098d9a201b4ff70c8 2023-07-19 13:11:55,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:55,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307193e4c093c20de465e94e6ed893d391300 2023-07-19 13:11:55,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:55,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,776 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 13:11:55,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,777 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:55,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689772315532Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689772315707 (+175 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689772315707Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689772315707Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689772315711 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689772315727 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689772315776 (+49 ms) 2023-07-19 13:11:55,780 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 13:11:55,782 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 247 msec 2023-07-19 13:11:55,835 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:55,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 13:11:55,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:55,867 DEBUG [Listener at jenkins-hbase4.apache.org/36809] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 13:11:55,872 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 13:11:55,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40427] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 13:11:55,875 DEBUG [Listener at jenkins-hbase4.apache.org/36809] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 13:11:55,879 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 13:11:55,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40947] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 13:11:55,880 DEBUG [Listener at jenkins-hbase4.apache.org/36809] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 13:11:55,884 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42050, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 13:11:55,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41603] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 13:11:55,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 13:11:55,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:55,889 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:11:55,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-19 13:11:55,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 13:11:55,890 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:11:55,893 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:11:55,893 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b 2023-07-19 13:11:55,894 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4 empty. 2023-07-19 13:11:55,894 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b empty. 2023-07-19 13:11:55,894 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:11:55,894 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b 2023-07-19 13:11:55,894 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 13:11:55,906 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-19 13:11:55,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5c8bdc90e160fd96d5612b4077c3aab4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:11:55,908 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2745528f6c71903602e5a513e20a001b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:11:55,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:55,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 2745528f6c71903602e5a513e20a001b, disabling compactions & flushes 2023-07-19 13:11:55,925 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. 2023-07-19 13:11:55,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. 2023-07-19 13:11:55,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. after waiting 0 ms 2023-07-19 13:11:55,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. 2023-07-19 13:11:55,925 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. 2023-07-19 13:11:55,925 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 2745528f6c71903602e5a513e20a001b: 2023-07-19 13:11:55,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:55,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 5c8bdc90e160fd96d5612b4077c3aab4, disabling compactions & flushes 2023-07-19 13:11:55,928 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. 2023-07-19 13:11:55,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. 2023-07-19 13:11:55,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. after waiting 0 ms 2023-07-19 13:11:55,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. 2023-07-19 13:11:55,928 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. 2023-07-19 13:11:55,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 5c8bdc90e160fd96d5612b4077c3aab4: 2023-07-19 13:11:55,930 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:11:55,931 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772315931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772315931"}]},"ts":"1689772315931"} 2023-07-19 13:11:55,931 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772315931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772315931"}]},"ts":"1689772315931"} 2023-07-19 13:11:55,933 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:11:55,934 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:11:55,934 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772315934"}]},"ts":"1689772315934"} 2023-07-19 13:11:55,935 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-19 13:11:55,939 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:11:55,940 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:11:55,940 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:11:55,941 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:11:55,941 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:11:55,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5c8bdc90e160fd96d5612b4077c3aab4, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2745528f6c71903602e5a513e20a001b, ASSIGN}] 2023-07-19 13:11:55,944 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5c8bdc90e160fd96d5612b4077c3aab4, ASSIGN 2023-07-19 13:11:55,944 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2745528f6c71903602e5a513e20a001b, ASSIGN 2023-07-19 13:11:55,951 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5c8bdc90e160fd96d5612b4077c3aab4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40947,1689772233100; forceNewPlan=false, retain=false 2023-07-19 13:11:55,951 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2745528f6c71903602e5a513e20a001b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40427,1689772233020; forceNewPlan=false, retain=false 2023-07-19 13:11:55,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 13:11:56,101 INFO [jenkins-hbase4:33091] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:11:56,104 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5c8bdc90e160fd96d5612b4077c3aab4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:56,104 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=2745528f6c71903602e5a513e20a001b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:56,105 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772316104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772316104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772316104"}]},"ts":"1689772316104"} 2023-07-19 13:11:56,105 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772316104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772316104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772316104"}]},"ts":"1689772316104"} 2023-07-19 13:11:56,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 5c8bdc90e160fd96d5612b4077c3aab4, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:11:56,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 2745528f6c71903602e5a513e20a001b, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:11:56,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 13:11:56,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. 2023-07-19 13:11:56,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5c8bdc90e160fd96d5612b4077c3aab4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4.', STARTKEY => '', ENDKEY => '2'} 2023-07-19 13:11:56,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. service=AccessControlService 2023-07-19 13:11:56,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:56,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:11:56,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:56,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:11:56,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:11:56,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. 2023-07-19 13:11:56,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2745528f6c71903602e5a513e20a001b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b.', STARTKEY => '2', ENDKEY => ''} 2023-07-19 13:11:56,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. service=AccessControlService 2023-07-19 13:11:56,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:56,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2745528f6c71903602e5a513e20a001b 2023-07-19 13:11:56,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:56,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2745528f6c71903602e5a513e20a001b 2023-07-19 13:11:56,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2745528f6c71903602e5a513e20a001b 2023-07-19 13:11:56,266 INFO [StoreOpener-5c8bdc90e160fd96d5612b4077c3aab4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:11:56,268 INFO [StoreOpener-2745528f6c71903602e5a513e20a001b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2745528f6c71903602e5a513e20a001b 2023-07-19 13:11:56,268 DEBUG [StoreOpener-5c8bdc90e160fd96d5612b4077c3aab4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/cf 2023-07-19 13:11:56,268 DEBUG [StoreOpener-5c8bdc90e160fd96d5612b4077c3aab4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/cf 2023-07-19 13:11:56,269 INFO [StoreOpener-5c8bdc90e160fd96d5612b4077c3aab4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c8bdc90e160fd96d5612b4077c3aab4 columnFamilyName cf 2023-07-19 13:11:56,269 INFO [StoreOpener-5c8bdc90e160fd96d5612b4077c3aab4-1] regionserver.HStore(310): Store=5c8bdc90e160fd96d5612b4077c3aab4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:56,270 DEBUG [StoreOpener-2745528f6c71903602e5a513e20a001b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/cf 2023-07-19 13:11:56,270 DEBUG [StoreOpener-2745528f6c71903602e5a513e20a001b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/cf 2023-07-19 13:11:56,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:11:56,270 INFO [StoreOpener-2745528f6c71903602e5a513e20a001b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2745528f6c71903602e5a513e20a001b columnFamilyName cf 2023-07-19 13:11:56,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:11:56,271 INFO [StoreOpener-2745528f6c71903602e5a513e20a001b-1] regionserver.HStore(310): Store=2745528f6c71903602e5a513e20a001b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:56,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b 2023-07-19 13:11:56,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b 2023-07-19 13:11:56,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:11:56,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2745528f6c71903602e5a513e20a001b 2023-07-19 13:11:56,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:56,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:56,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2745528f6c71903602e5a513e20a001b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74991006, jitterRate=0.11745306849479675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:56,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5c8bdc90e160fd96d5612b4077c3aab4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60428538, jitterRate=-0.09954461455345154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:56,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2745528f6c71903602e5a513e20a001b: 2023-07-19 13:11:56,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5c8bdc90e160fd96d5612b4077c3aab4: 2023-07-19 13:11:56,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b., pid=70, masterSystemTime=1689772316262 2023-07-19 13:11:56,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4., pid=69, masterSystemTime=1689772316259 2023-07-19 13:11:56,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. 2023-07-19 13:11:56,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. 2023-07-19 13:11:56,282 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=2745528f6c71903602e5a513e20a001b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:56,282 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772316282"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772316282"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772316282"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772316282"}]},"ts":"1689772316282"} 2023-07-19 13:11:56,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. 2023-07-19 13:11:56,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. 2023-07-19 13:11:56,284 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5c8bdc90e160fd96d5612b4077c3aab4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:56,284 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772316284"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772316284"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772316284"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772316284"}]},"ts":"1689772316284"} 2023-07-19 13:11:56,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-19 13:11:56,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-19 13:11:56,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 2745528f6c71903602e5a513e20a001b, server=jenkins-hbase4.apache.org,40427,1689772233020 in 176 msec 2023-07-19 13:11:56,293 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 5c8bdc90e160fd96d5612b4077c3aab4, server=jenkins-hbase4.apache.org,40947,1689772233100 in 180 msec 2023-07-19 13:11:56,294 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2745528f6c71903602e5a513e20a001b, ASSIGN in 351 msec 2023-07-19 13:11:56,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-19 13:11:56,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5c8bdc90e160fd96d5612b4077c3aab4, ASSIGN in 352 msec 2023-07-19 13:11:56,296 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:11:56,296 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772316296"}]},"ts":"1689772316296"} 2023-07-19 13:11:56,297 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-19 13:11:56,299 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:11:56,300 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-19 13:11:56,302 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 13:11:56,303 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:56,304 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:56,304 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:56,304 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:56,305 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:56,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:56,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:56,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:56,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:56,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:56,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:56,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:56,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 419 msec 2023-07-19 13:11:56,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 13:11:56,496 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-19 13:11:56,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 5c8bdc90e160fd96d5612b4077c3aab4, 2745528f6c71903602e5a513e20a001b 2023-07-19 13:11:56,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5c8bdc90e160fd96d5612b4077c3aab4, 2745528f6c71903602e5a513e20a001b], force=true 2023-07-19 13:11:56,534 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5c8bdc90e160fd96d5612b4077c3aab4, 2745528f6c71903602e5a513e20a001b], force=true 2023-07-19 13:11:56,534 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5c8bdc90e160fd96d5612b4077c3aab4, 2745528f6c71903602e5a513e20a001b], force=true 2023-07-19 13:11:56,534 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5c8bdc90e160fd96d5612b4077c3aab4, 2745528f6c71903602e5a513e20a001b], force=true 2023-07-19 13:11:56,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 13:11:56,562 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5c8bdc90e160fd96d5612b4077c3aab4, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2745528f6c71903602e5a513e20a001b, UNASSIGN}] 2023-07-19 13:11:56,564 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5c8bdc90e160fd96d5612b4077c3aab4, UNASSIGN 2023-07-19 13:11:56,565 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5c8bdc90e160fd96d5612b4077c3aab4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:56,565 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772316565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772316565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772316565"}]},"ts":"1689772316565"} 2023-07-19 13:11:56,566 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2745528f6c71903602e5a513e20a001b, UNASSIGN 2023-07-19 13:11:56,567 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=2745528f6c71903602e5a513e20a001b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:56,567 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772316567"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772316567"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772316567"}]},"ts":"1689772316567"} 2023-07-19 13:11:56,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 5c8bdc90e160fd96d5612b4077c3aab4, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:11:56,573 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 2745528f6c71903602e5a513e20a001b, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:11:56,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 13:11:56,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:11:56,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5c8bdc90e160fd96d5612b4077c3aab4, disabling compactions & flushes 2023-07-19 13:11:56,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. 2023-07-19 13:11:56,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. 2023-07-19 13:11:56,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. after waiting 0 ms 2023-07-19 13:11:56,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. 2023-07-19 13:11:56,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5c8bdc90e160fd96d5612b4077c3aab4 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 13:11:56,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2745528f6c71903602e5a513e20a001b 2023-07-19 13:11:56,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2745528f6c71903602e5a513e20a001b, disabling compactions & flushes 2023-07-19 13:11:56,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. 2023-07-19 13:11:56,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. 2023-07-19 13:11:56,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. after waiting 0 ms 2023-07-19 13:11:56,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. 2023-07-19 13:11:56,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2745528f6c71903602e5a513e20a001b 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 13:11:56,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/.tmp/cf/f9d29c4294204a1ab75074d1f5718e14 2023-07-19 13:11:56,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/.tmp/cf/d75cf007f3b8480eb16be07aadba9e33 2023-07-19 13:11:56,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/.tmp/cf/f9d29c4294204a1ab75074d1f5718e14 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/cf/f9d29c4294204a1ab75074d1f5718e14 2023-07-19 13:11:56,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/.tmp/cf/d75cf007f3b8480eb16be07aadba9e33 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/cf/d75cf007f3b8480eb16be07aadba9e33 2023-07-19 13:11:56,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/cf/f9d29c4294204a1ab75074d1f5718e14, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 13:11:56,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/cf/d75cf007f3b8480eb16be07aadba9e33, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 13:11:56,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5c8bdc90e160fd96d5612b4077c3aab4 in 46ms, sequenceid=5, compaction requested=false 2023-07-19 13:11:56,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 2745528f6c71903602e5a513e20a001b in 44ms, sequenceid=5, compaction requested=false 2023-07-19 13:11:56,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 13:11:56,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 13:11:56,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 13:11:56,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 13:11:56,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:56,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b. 2023-07-19 13:11:56,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2745528f6c71903602e5a513e20a001b: 2023-07-19 13:11:56,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:56,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4. 2023-07-19 13:11:56,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5c8bdc90e160fd96d5612b4077c3aab4: 2023-07-19 13:11:56,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2745528f6c71903602e5a513e20a001b 2023-07-19 13:11:56,791 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=2745528f6c71903602e5a513e20a001b, regionState=CLOSED 2023-07-19 13:11:56,791 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772316791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772316791"}]},"ts":"1689772316791"} 2023-07-19 13:11:56,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:11:56,792 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5c8bdc90e160fd96d5612b4077c3aab4, regionState=CLOSED 2023-07-19 13:11:56,792 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772316792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772316792"}]},"ts":"1689772316792"} 2023-07-19 13:11:56,796 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-19 13:11:56,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-19 13:11:56,796 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 5c8bdc90e160fd96d5612b4077c3aab4, server=jenkins-hbase4.apache.org,40947,1689772233100 in 227 msec 2023-07-19 13:11:56,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 2745528f6c71903602e5a513e20a001b, server=jenkins-hbase4.apache.org,40427,1689772233020 in 221 msec 2023-07-19 13:11:56,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5c8bdc90e160fd96d5612b4077c3aab4, UNASSIGN in 238 msec 2023-07-19 13:11:56,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-19 13:11:56,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2745528f6c71903602e5a513e20a001b, UNASSIGN in 234 msec 2023-07-19 13:11:56,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 13:11:56,939 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-19 13:11:56,948 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315886.5c8bdc90e160fd96d5612b4077c3aab4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:56,949 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772315886.2745528f6c71903602e5a513e20a001b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:56,949 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:57,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b30b98a339558cf070fcd5b82dbd59fb, ASSIGN}] 2023-07-19 13:11:57,022 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b30b98a339558cf070fcd5b82dbd59fb, ASSIGN 2023-07-19 13:11:57,023 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b30b98a339558cf070fcd5b82dbd59fb, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,40947,1689772233100; forceNewPlan=false, retain=false 2023-07-19 13:11:57,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 13:11:57,174 INFO [jenkins-hbase4:33091] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 13:11:57,175 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b30b98a339558cf070fcd5b82dbd59fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,176 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689772317175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772317175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772317175"}]},"ts":"1689772317175"} 2023-07-19 13:11:57,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure b30b98a339558cf070fcd5b82dbd59fb, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:11:57,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. 2023-07-19 13:11:57,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b30b98a339558cf070fcd5b82dbd59fb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb.', STARTKEY => '', ENDKEY => ''} 2023-07-19 13:11:57,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. service=AccessControlService 2023-07-19 13:11:57,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:57,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b30b98a339558cf070fcd5b82dbd59fb 2023-07-19 13:11:57,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:57,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b30b98a339558cf070fcd5b82dbd59fb 2023-07-19 13:11:57,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b30b98a339558cf070fcd5b82dbd59fb 2023-07-19 13:11:57,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/.regioninfo 2023-07-19 13:11:57,357 INFO [StoreOpener-b30b98a339558cf070fcd5b82dbd59fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b30b98a339558cf070fcd5b82dbd59fb 2023-07-19 13:11:57,358 DEBUG [StoreOpener-b30b98a339558cf070fcd5b82dbd59fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf 2023-07-19 13:11:57,358 DEBUG [StoreOpener-b30b98a339558cf070fcd5b82dbd59fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf 2023-07-19 13:11:57,359 INFO [StoreOpener-b30b98a339558cf070fcd5b82dbd59fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b30b98a339558cf070fcd5b82dbd59fb columnFamilyName cf 2023-07-19 13:11:57,401 DEBUG [StoreOpener-b30b98a339558cf070fcd5b82dbd59fb-1] regionserver.HStore(539): loaded hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf/d75cf007f3b8480eb16be07aadba9e33.2745528f6c71903602e5a513e20a001b->hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/cf/d75cf007f3b8480eb16be07aadba9e33-top 2023-07-19 13:11:57,408 DEBUG [StoreOpener-b30b98a339558cf070fcd5b82dbd59fb-1] regionserver.HStore(539): loaded hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf/f9d29c4294204a1ab75074d1f5718e14.5c8bdc90e160fd96d5612b4077c3aab4->hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/cf/f9d29c4294204a1ab75074d1f5718e14-top 2023-07-19 13:11:57,408 INFO [StoreOpener-b30b98a339558cf070fcd5b82dbd59fb-1] regionserver.HStore(310): Store=b30b98a339558cf070fcd5b82dbd59fb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:57,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb 2023-07-19 13:11:57,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb 2023-07-19 13:11:57,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b30b98a339558cf070fcd5b82dbd59fb 2023-07-19 13:11:57,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b30b98a339558cf070fcd5b82dbd59fb; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72617348, jitterRate=0.08208280801773071}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:57,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b30b98a339558cf070fcd5b82dbd59fb: 2023-07-19 13:11:57,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb., pid=77, masterSystemTime=1689772317329 2023-07-19 13:11:57,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb.,because compaction is disabled. 2023-07-19 13:11:57,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. 2023-07-19 13:11:57,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. 2023-07-19 13:11:57,421 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b30b98a339558cf070fcd5b82dbd59fb, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,421 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689772317420"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772317420"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772317420"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772317420"}]},"ts":"1689772317420"} 2023-07-19 13:11:57,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-19 13:11:57,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure b30b98a339558cf070fcd5b82dbd59fb, server=jenkins-hbase4.apache.org,40947,1689772233100 in 245 msec 2023-07-19 13:11:57,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-19 13:11:57,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b30b98a339558cf070fcd5b82dbd59fb, ASSIGN in 404 msec 2023-07-19 13:11:57,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5c8bdc90e160fd96d5612b4077c3aab4, 2745528f6c71903602e5a513e20a001b], force=true in 900 msec 2023-07-19 13:11:57,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 13:11:57,642 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-19 13:11:57,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 13:11:57,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772317643 (current time:1689772317643). 2023-07-19 13:11:57,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:57,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x4112d54f to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:57,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77bd2a22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:57,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:57,667 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:57,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4112d54f to 127.0.0.1:64840 2023-07-19 13:11:57,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:57,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x360e1767 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:57,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61611444, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:57,778 DEBUG [hconnection-0x7f13ce70-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:57,782 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:57,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x360e1767 to 127.0.0.1:64840 2023-07-19 13:11:57,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:57,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 13:11:57,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:57,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 13:11:57,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 13:11:57,795 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 13:11:57,796 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689772917796 2023-07-19 13:11:57,797 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 13:11:57,802 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:57,802 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:57,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 13:11:57,804 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 13:11:57,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 11 msec 2023-07-19 13:11:57,806 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 13:11:57,806 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689772917806 2023-07-19 13:11:57,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,825 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 13:11:57,825 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:57,827 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-19 13:11:57,827 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-19 13:11:57,827 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,827 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,829 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,829 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:57,829 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:57,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:57,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:57,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:57,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:57,830 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,830 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:57,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 13:11:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,831 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 13:11:57,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,833 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,833 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 13:11:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 13:11:57,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,833 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:57,835 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:57,835 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 13:11:57,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:57,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:57,835 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 13:11:57,835 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 13:11:57,835 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,835 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 13:11:57,835 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 13:11:57,835 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:57,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,837 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 13:11:57,837 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 13:11:57,837 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 13:11:57,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,838 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 13:11:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 13:11:57,839 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,839 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:57,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,839 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 13:11:57,839 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:57,840 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 13:11:57,840 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 13:11:57,840 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 13:11:57,840 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,840 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:57,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:57,841 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:57,841 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:57,842 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,842 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,842 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:57,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:57,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:57,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:57,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-19 13:11:57,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e9d2da4[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:57,844 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-19 13:11:57,845 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,850 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,851 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,851 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 13:11:57,851 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 13:11:57,851 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,851 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:11:57,851 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 13:11:57,851 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 13:11:57,851 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:11:57,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,851 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 13:11:57,853 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 13:11:57,853 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:57,853 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,853 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 13:11:57,853 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:57,855 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 13:11:57,855 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:57,855 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 13:11:57,860 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:57,868 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:57,868 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. 2023-07-19 13:11:57,868 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. started... 2023-07-19 13:11:57,870 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b30b98a339558cf070fcd5b82dbd59fb: 2023-07-19 13:11:57,870 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,870 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:57,870 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf/d75cf007f3b8480eb16be07aadba9e33.2745528f6c71903602e5a513e20a001b->hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/cf/d75cf007f3b8480eb16be07aadba9e33-top, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf/f9d29c4294204a1ab75074d1f5718e14.5c8bdc90e160fd96d5612b4077c3aab4->hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/cf/f9d29c4294204a1ab75074d1f5718e14-top] hfiles 2023-07-19 13:11:57,870 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf/d75cf007f3b8480eb16be07aadba9e33.2745528f6c71903602e5a513e20a001b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,871 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf/f9d29c4294204a1ab75074d1f5718e14.5c8bdc90e160fd96d5612b4077c3aab4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,887 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. completed. 2023-07-19 13:11:57,887 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. 2023-07-19 13:11:57,887 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:57,887 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:57,887 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,887 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 13:11:57,887 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:11:57,895 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:57,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:57,896 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 13:11:57,896 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:57,898 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 13:11:57,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:57,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:57,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:57,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:57,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:57,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:57,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,902 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:57,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:57,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,40947,1689772233100': 2023-07-19 13:11:57,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-19 13:11:57,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 13:11:57,903 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-19 13:11:57,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:57,903 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:57,904 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:57,904 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,904 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:57,904 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:57,906 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,906 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,906 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,906 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:57,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:57,906 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:57,906 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:57,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,907 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:57,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:57,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:57,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:57,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:57,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:57,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:57,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,911 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:57,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:57,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,924 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,925 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:57,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:57,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:57,932 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:57,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:57,932 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,932 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:57,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:57,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:57,937 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:57,937 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:57,937 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:57,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:57,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:57,937 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,937 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,937 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:57,937 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:57,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:57,937 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:57,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:57,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:57,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:57,937 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:57,937 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,938 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:57,938 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,938 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:11:57,938 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,938 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:11:57,938 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:11:57,938 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,938 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,937 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:57,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:57,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:57,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:57,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:57,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:57,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:58,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:58,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-19 13:11:58,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:58,056 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:58,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689772317797Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689772317937 (+140 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689772317937Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689772317945 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689772317979 (+34 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689772318055 (+76 ms) 2023-07-19 13:11:58,060 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 13:11:58,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 259 msec 2023-07-19 13:11:58,104 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:58,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 13:11:58,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:58,106 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772318106 2023-07-19 13:11:58,106 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42143, tgtDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772318106, rawTgtDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772318106, srcFsUri=hdfs://localhost:42143, srcDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:11:58,144 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:11:58,144 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2134517310_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772318106, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772318106/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:58,144 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5, snapshotDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-19 13:11:58,159 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772318106/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:58,187 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,188 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,188 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,189 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,661 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0004_000001 (auth:SIMPLE) 2023-07-19 13:11:59,321 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-6849883467418122338.jar 2023-07-19 13:11:59,322 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:59,323 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:59,411 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-2689018886358306815.jar 2023-07-19 13:11:59,412 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:59,413 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:59,413 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:59,413 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:59,414 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:59,414 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:59,415 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:11:59,416 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:11:59,416 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:11:59,418 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:11:59,419 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:11:59,419 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:11:59,420 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:11:59,420 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:11:59,421 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:11:59,421 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:11:59,422 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:59,423 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:59,423 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:59,424 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:59,424 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:59,425 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:59,425 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:59,786 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:12:00,040 WARN [DataStreamer for file /user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689772242192_0005/libjars/protobuf-java-2.5.0.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-19 13:12:01,691 WARN [Listener at jenkins-hbase4.apache.org/36809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:12:01,695 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-19 13:12:01,698 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-19 13:12:01,794 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:12:01,794 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:12:02,214 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0005_000001 (auth:SIMPLE) 2023-07-19 13:12:08,597 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0005_000001 (auth:SIMPLE) 2023-07-19 13:12:10,979 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0005_000001 (auth:SIMPLE) 2023-07-19 13:12:16,460 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0005_000001 (auth:SIMPLE) 2023-07-19 13:12:18,010 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:12:18,015 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:12:18,026 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,026 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:12:18,027 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:12:18,027 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583241713_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,028 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 13:12:18,028 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 13:12:18,028 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583241713_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772318106/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772318106/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,029 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772318106/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 13:12:18,029 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772318106/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 13:12:18,037 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 13:12:18,042 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772338042"}]},"ts":"1689772338042"} 2023-07-19 13:12:18,043 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-19 13:12:18,070 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-19 13:12:18,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b30b98a339558cf070fcd5b82dbd59fb, UNASSIGN}] 2023-07-19 13:12:18,073 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b30b98a339558cf070fcd5b82dbd59fb, UNASSIGN 2023-07-19 13:12:18,074 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b30b98a339558cf070fcd5b82dbd59fb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:18,074 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689772338074"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772338074"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772338074"}]},"ts":"1689772338074"} 2023-07-19 13:12:18,076 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure b30b98a339558cf070fcd5b82dbd59fb, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:12:18,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 13:12:18,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b30b98a339558cf070fcd5b82dbd59fb 2023-07-19 13:12:18,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b30b98a339558cf070fcd5b82dbd59fb, disabling compactions & flushes 2023-07-19 13:12:18,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. 2023-07-19 13:12:18,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. 2023-07-19 13:12:18,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. after waiting 0 ms 2023-07-19 13:12:18,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. 2023-07-19 13:12:18,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-19 13:12:18,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:18,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb. 2023-07-19 13:12:18,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b30b98a339558cf070fcd5b82dbd59fb: 2023-07-19 13:12:18,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b30b98a339558cf070fcd5b82dbd59fb 2023-07-19 13:12:18,244 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b30b98a339558cf070fcd5b82dbd59fb, regionState=CLOSED 2023-07-19 13:12:18,244 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689772338244"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772338244"}]},"ts":"1689772338244"} 2023-07-19 13:12:18,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-19 13:12:18,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure b30b98a339558cf070fcd5b82dbd59fb, server=jenkins-hbase4.apache.org,40947,1689772233100 in 170 msec 2023-07-19 13:12:18,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-19 13:12:18,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b30b98a339558cf070fcd5b82dbd59fb, UNASSIGN in 177 msec 2023-07-19 13:12:18,251 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772338251"}]},"ts":"1689772338251"} 2023-07-19 13:12:18,254 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-19 13:12:18,270 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-19 13:12:18,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 234 msec 2023-07-19 13:12:18,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 13:12:18,344 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-19 13:12:18,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,348 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,349 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,350 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,353 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb 2023-07-19 13:12:18,353 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:12:18,353 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b 2023-07-19 13:12:18,355 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/recovered.edits] 2023-07-19 13:12:18,355 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/recovered.edits] 2023-07-19 13:12:18,355 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/recovered.edits] 2023-07-19 13:12:18,361 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf/d75cf007f3b8480eb16be07aadba9e33.2745528f6c71903602e5a513e20a001b to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf/d75cf007f3b8480eb16be07aadba9e33.2745528f6c71903602e5a513e20a001b 2023-07-19 13:12:18,361 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/cf/d75cf007f3b8480eb16be07aadba9e33 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/cf/d75cf007f3b8480eb16be07aadba9e33 2023-07-19 13:12:18,361 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/cf/f9d29c4294204a1ab75074d1f5718e14 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/cf/f9d29c4294204a1ab75074d1f5718e14 2023-07-19 13:12:18,367 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf/f9d29c4294204a1ab75074d1f5718e14.5c8bdc90e160fd96d5612b4077c3aab4 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/cf/f9d29c4294204a1ab75074d1f5718e14.5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:12:18,369 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/recovered.edits/8.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b/recovered.edits/8.seqid 2023-07-19 13:12:18,370 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2745528f6c71903602e5a513e20a001b 2023-07-19 13:12:18,371 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/recovered.edits/8.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4/recovered.edits/8.seqid 2023-07-19 13:12:18,371 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5c8bdc90e160fd96d5612b4077c3aab4 2023-07-19 13:12:18,373 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/recovered.edits/12.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb/recovered.edits/12.seqid 2023-07-19 13:12:18,374 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b30b98a339558cf070fcd5b82dbd59fb 2023-07-19 13:12:18,374 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 13:12:18,380 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,383 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-19 13:12:18,416 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,416 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,416 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,416 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 13:12:18,418 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-19 13:12:18,419 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,419 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-19 13:12:18,419 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772338419"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:18,421 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-19 13:12:18,421 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b30b98a339558cf070fcd5b82dbd59fb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689772315887.b30b98a339558cf070fcd5b82dbd59fb.', STARTKEY => '', ENDKEY => ''}] 2023-07-19 13:12:18,421 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-19 13:12:18,421 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772338421"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:18,422 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-19 13:12:18,447 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-19 13:12:18,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-19 13:12:18,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-19 13:12:18,447 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:12:18,447 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:18,447 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:18,447 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:18,447 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:18,447 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:12:18,447 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:12:18,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 13:12:18,478 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:18,478 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:18,478 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:18,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:18,479 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:18,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 134 msec 2023-07-19 13:12:18,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 13:12:18,550 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-19 13:12:18,551 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:18,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:18,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:18,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 13:12:18,557 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772338556"}]},"ts":"1689772338556"} 2023-07-19 13:12:18,558 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-19 13:12:18,593 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-19 13:12:18,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71ca3bbc5083cfdb4003e39dad89e3d1, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a5da6a0e9001cc546b01f265aeaf3b1, UNASSIGN}] 2023-07-19 13:12:18,597 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71ca3bbc5083cfdb4003e39dad89e3d1, UNASSIGN 2023-07-19 13:12:18,597 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a5da6a0e9001cc546b01f265aeaf3b1, UNASSIGN 2023-07-19 13:12:18,597 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=71ca3bbc5083cfdb4003e39dad89e3d1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:18,598 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772338597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772338597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772338597"}]},"ts":"1689772338597"} 2023-07-19 13:12:18,598 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0a5da6a0e9001cc546b01f265aeaf3b1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:18,598 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772338598"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772338598"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772338598"}]},"ts":"1689772338598"} 2023-07-19 13:12:18,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 71ca3bbc5083cfdb4003e39dad89e3d1, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:12:18,600 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 0a5da6a0e9001cc546b01f265aeaf3b1, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:12:18,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 13:12:18,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:12:18,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 71ca3bbc5083cfdb4003e39dad89e3d1, disabling compactions & flushes 2023-07-19 13:12:18,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:12:18,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:12:18,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:12:18,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. after waiting 0 ms 2023-07-19 13:12:18,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:12:18,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a5da6a0e9001cc546b01f265aeaf3b1, disabling compactions & flushes 2023-07-19 13:12:18,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:12:18,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:12:18,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. after waiting 0 ms 2023-07-19 13:12:18,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:12:18,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:12:18,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:18,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1. 2023-07-19 13:12:18,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:12:18,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 71ca3bbc5083cfdb4003e39dad89e3d1: 2023-07-19 13:12:18,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:18,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1. 2023-07-19 13:12:18,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a5da6a0e9001cc546b01f265aeaf3b1: 2023-07-19 13:12:18,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:12:18,781 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=71ca3bbc5083cfdb4003e39dad89e3d1, regionState=CLOSED 2023-07-19 13:12:18,781 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772338781"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772338781"}]},"ts":"1689772338781"} 2023-07-19 13:12:18,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:12:18,782 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0a5da6a0e9001cc546b01f265aeaf3b1, regionState=CLOSED 2023-07-19 13:12:18,782 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772338782"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772338782"}]},"ts":"1689772338782"} 2023-07-19 13:12:18,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-19 13:12:18,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 71ca3bbc5083cfdb4003e39dad89e3d1, server=jenkins-hbase4.apache.org,40427,1689772233020 in 185 msec 2023-07-19 13:12:18,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-19 13:12:18,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 0a5da6a0e9001cc546b01f265aeaf3b1, server=jenkins-hbase4.apache.org,40947,1689772233100 in 185 msec 2023-07-19 13:12:18,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=71ca3bbc5083cfdb4003e39dad89e3d1, UNASSIGN in 193 msec 2023-07-19 13:12:18,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-19 13:12:18,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a5da6a0e9001cc546b01f265aeaf3b1, UNASSIGN in 194 msec 2023-07-19 13:12:18,791 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772338791"}]},"ts":"1689772338791"} 2023-07-19 13:12:18,793 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-19 13:12:18,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 13:12:18,862 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-19 13:12:18,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 312 msec 2023-07-19 13:12:19,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 13:12:19,161 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-19 13:12:19,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,166 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,167 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,171 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,175 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,175 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,175 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,175 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,176 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 13:12:19,176 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 13:12:19,176 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 13:12:19,176 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:12:19,176 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:12:19,176 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 13:12:19,178 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,178 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,178 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:19,178 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,179 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:19,178 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:19,178 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,179 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:19,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 13:12:19,180 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/recovered.edits] 2023-07-19 13:12:19,183 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/recovered.edits] 2023-07-19 13:12:19,185 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/cf/af785dc491c64e93940d2b433182ffd5 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/cf/af785dc491c64e93940d2b433182ffd5 2023-07-19 13:12:19,189 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/cf/94a2eeb3181d45fe9f9e765c06c3d533 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/cf/94a2eeb3181d45fe9f9e765c06c3d533 2023-07-19 13:12:19,191 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/recovered.edits/9.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1/recovered.edits/9.seqid 2023-07-19 13:12:19,192 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a5da6a0e9001cc546b01f265aeaf3b1 2023-07-19 13:12:19,195 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/recovered.edits/9.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1/recovered.edits/9.seqid 2023-07-19 13:12:19,196 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/71ca3bbc5083cfdb4003e39dad89e3d1 2023-07-19 13:12:19,196 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 13:12:19,196 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-19 13:12:19,198 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-19 13:12:19,206 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719daba88561f3c4c2098d9a201b4ff70c8 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230719daba88561f3c4c2098d9a201b4ff70c8 2023-07-19 13:12:19,212 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307193e4c093c20de465e94e6ed893d391300 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307193e4c093c20de465e94e6ed893d391300 2023-07-19 13:12:19,213 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-19 13:12:19,217 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,220 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-19 13:12:19,222 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-19 13:12:19,223 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,223 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-19 13:12:19,223 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772339223"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:19,223 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772339223"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:19,227 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 13:12:19,227 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 71ca3bbc5083cfdb4003e39dad89e3d1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689772314488.71ca3bbc5083cfdb4003e39dad89e3d1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0a5da6a0e9001cc546b01f265aeaf3b1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689772314488.0a5da6a0e9001cc546b01f265aeaf3b1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 13:12:19,227 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-19 13:12:19,227 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772339227"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:19,230 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-19 13:12:19,233 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,234 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 71 msec 2023-07-19 13:12:19,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 13:12:19,281 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-19 13:12:19,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 13:12:19,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 13:12:19,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:19,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-19 13:12:19,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:19,367 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 746) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:57904 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_647904520_1 at /127.0.0.1:37834 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:33399 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:37846 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:37730 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:57916 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4105 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=906 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=483 (was 357) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=1927 (was 2737) 2023-07-19 13:12:19,367 WARN [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-19 13:12:19,398 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=483, ProcessCount=185, AvailableMemoryMB=1922 2023-07-19 13:12:19,398 WARN [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-19 13:12:19,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 13:12:19,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:19,405 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:12:19,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-19 13:12:19,406 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:12:19,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 13:12:19,409 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:19,409 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:19,412 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5 empty. 2023-07-19 13:12:19,412 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30 empty. 2023-07-19 13:12:19,412 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:19,412 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:19,414 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 13:12:19,431 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 13:12:19,433 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5b31a12358b15b000476276caaa9bc30, NAME => 'testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:12:19,434 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f33216d65e8b513e78c135a1a31420d5, NAME => 'testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:12:19,488 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:19,489 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 5b31a12358b15b000476276caaa9bc30, disabling compactions & flushes 2023-07-19 13:12:19,489 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:19,489 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:19,489 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. after waiting 0 ms 2023-07-19 13:12:19,489 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:19,491 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:19,491 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 5b31a12358b15b000476276caaa9bc30: 2023-07-19 13:12:19,492 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:19,492 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f33216d65e8b513e78c135a1a31420d5, disabling compactions & flushes 2023-07-19 13:12:19,492 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:19,492 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:19,492 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. after waiting 0 ms 2023-07-19 13:12:19,492 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:19,492 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:19,492 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f33216d65e8b513e78c135a1a31420d5: 2023-07-19 13:12:19,495 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:12:19,496 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772339496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772339496"}]},"ts":"1689772339496"} 2023-07-19 13:12:19,496 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772339496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772339496"}]},"ts":"1689772339496"} 2023-07-19 13:12:19,498 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:12:19,499 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:12:19,499 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772339499"}]},"ts":"1689772339499"} 2023-07-19 13:12:19,501 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 13:12:19,506 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:12:19,507 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:12:19,508 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:12:19,508 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:12:19,508 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:12:19,508 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b31a12358b15b000476276caaa9bc30, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f33216d65e8b513e78c135a1a31420d5, ASSIGN}] 2023-07-19 13:12:19,511 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b31a12358b15b000476276caaa9bc30, ASSIGN 2023-07-19 13:12:19,511 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f33216d65e8b513e78c135a1a31420d5, ASSIGN 2023-07-19 13:12:19,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 13:12:19,512 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b31a12358b15b000476276caaa9bc30, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40427,1689772233020; forceNewPlan=false, retain=false 2023-07-19 13:12:19,512 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f33216d65e8b513e78c135a1a31420d5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40947,1689772233100; forceNewPlan=false, retain=false 2023-07-19 13:12:19,662 INFO [jenkins-hbase4:33091] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:12:19,666 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f33216d65e8b513e78c135a1a31420d5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:19,666 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772339666"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772339666"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772339666"}]},"ts":"1689772339666"} 2023-07-19 13:12:19,667 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5b31a12358b15b000476276caaa9bc30, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:19,667 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772339666"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772339666"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772339666"}]},"ts":"1689772339666"} 2023-07-19 13:12:19,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure f33216d65e8b513e78c135a1a31420d5, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:12:19,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 5b31a12358b15b000476276caaa9bc30, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:12:19,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 13:12:19,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:19,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b31a12358b15b000476276caaa9bc30, NAME => 'testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 13:12:19,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. service=AccessControlService 2023-07-19 13:12:19,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:12:19,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:19,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:19,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:19,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:19,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:19,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f33216d65e8b513e78c135a1a31420d5, NAME => 'testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 13:12:19,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. service=AccessControlService 2023-07-19 13:12:19,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:12:19,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:19,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:19,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:19,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:19,842 INFO [StoreOpener-5b31a12358b15b000476276caaa9bc30-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:19,843 INFO [StoreOpener-f33216d65e8b513e78c135a1a31420d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:19,847 DEBUG [StoreOpener-f33216d65e8b513e78c135a1a31420d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/cf 2023-07-19 13:12:19,847 DEBUG [StoreOpener-f33216d65e8b513e78c135a1a31420d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/cf 2023-07-19 13:12:19,847 INFO [StoreOpener-f33216d65e8b513e78c135a1a31420d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f33216d65e8b513e78c135a1a31420d5 columnFamilyName cf 2023-07-19 13:12:19,849 INFO [StoreOpener-f33216d65e8b513e78c135a1a31420d5-1] regionserver.HStore(310): Store=f33216d65e8b513e78c135a1a31420d5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:12:19,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:19,851 DEBUG [StoreOpener-5b31a12358b15b000476276caaa9bc30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/cf 2023-07-19 13:12:19,851 DEBUG [StoreOpener-5b31a12358b15b000476276caaa9bc30-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/cf 2023-07-19 13:12:19,851 INFO [StoreOpener-5b31a12358b15b000476276caaa9bc30-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b31a12358b15b000476276caaa9bc30 columnFamilyName cf 2023-07-19 13:12:19,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:19,853 INFO [StoreOpener-5b31a12358b15b000476276caaa9bc30-1] regionserver.HStore(310): Store=5b31a12358b15b000476276caaa9bc30/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:12:19,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:19,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:19,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:19,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:12:19,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:19,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f33216d65e8b513e78c135a1a31420d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69991013, jitterRate=0.04294736683368683}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:12:19,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f33216d65e8b513e78c135a1a31420d5: 2023-07-19 13:12:19,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5., pid=93, masterSystemTime=1689772339821 2023-07-19 13:12:19,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:12:19,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b31a12358b15b000476276caaa9bc30; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74357917, jitterRate=0.10801930725574493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:12:19,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:19,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:19,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b31a12358b15b000476276caaa9bc30: 2023-07-19 13:12:19,865 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f33216d65e8b513e78c135a1a31420d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:19,866 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772339865"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772339865"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772339865"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772339865"}]},"ts":"1689772339865"} 2023-07-19 13:12:19,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30., pid=94, masterSystemTime=1689772339821 2023-07-19 13:12:19,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:19,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:19,871 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5b31a12358b15b000476276caaa9bc30, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:19,871 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772339871"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772339871"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772339871"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772339871"}]},"ts":"1689772339871"} 2023-07-19 13:12:19,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-19 13:12:19,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure f33216d65e8b513e78c135a1a31420d5, server=jenkins-hbase4.apache.org,40947,1689772233100 in 204 msec 2023-07-19 13:12:19,878 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-19 13:12:19,878 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 5b31a12358b15b000476276caaa9bc30, server=jenkins-hbase4.apache.org,40427,1689772233020 in 206 msec 2023-07-19 13:12:19,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f33216d65e8b513e78c135a1a31420d5, ASSIGN in 369 msec 2023-07-19 13:12:19,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-19 13:12:19,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b31a12358b15b000476276caaa9bc30, ASSIGN in 370 msec 2023-07-19 13:12:19,882 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:12:19,882 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772339882"}]},"ts":"1689772339882"} 2023-07-19 13:12:19,884 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 13:12:19,926 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:12:19,932 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-19 13:12:19,935 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 13:12:19,937 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:19,937 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:19,939 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:19,939 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:19,942 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:19,942 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:19,943 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:19,943 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:19,944 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:19,944 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:19,948 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 541 msec 2023-07-19 13:12:20,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 13:12:20,015 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-19 13:12:20,021 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 13:12:20,021 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:20,022 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:12:20,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:12:20,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772340070 (current time:1689772340070). 2023-07-19 13:12:20,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:12:20,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x27ca8c5c to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:20,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e747f32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:20,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:20,095 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35050, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:20,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27ca8c5c to 127.0.0.1:64840 2023-07-19 13:12:20,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:20,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x1386c78a to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:20,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60dd11ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:20,109 DEBUG [hconnection-0x1d2d7f0c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:20,110 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:20,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1386c78a to 127.0.0.1:64840 2023-07-19 13:12:20,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:20,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 13:12:20,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:12:20,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:12:20,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:12:20,121 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:12:20,125 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689772940125 2023-07-19 13:12:20,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:12:20,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 13:12:20,125 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:12:20,126 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:12:20,131 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:12:20,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 13:12:20,132 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-19 13:12:20,136 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 13:12:20,138 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689772940138 2023-07-19 13:12:20,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,176 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-19 13:12:20,176 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:20,178 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 13:12:20,178 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 13:12:20,179 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,179 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,183 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:20,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:20,183 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:20,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:20,183 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:20,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,184 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:20,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:20,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:20,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,185 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,185 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 13:12:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 13:12:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,185 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 13:12:20,185 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 13:12:20,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,186 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,186 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:12:20,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 13:12:20,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,186 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 13:12:20,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,188 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 13:12:20,189 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:20,189 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,196 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 13:12:20,196 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 13:12:20,196 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 13:12:20,196 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:20,196 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 13:12:20,198 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 13:12:20,198 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 13:12:20,196 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:20,198 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 13:12:20,198 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 13:12:20,199 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 13:12:20,200 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 13:12:20,200 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 13:12:20,204 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,205 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,205 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,205 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:20,205 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,206 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,206 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:20,205 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,206 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:20,206 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,206 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:20,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:20,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 13:12:20,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2451b3d1[Count = 1] remaining members to acquire global barrier 2023-07-19 13:12:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:20,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 13:12:20,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2451b3d1[Count = 0] remaining members to acquire global barrier 2023-07-19 13:12:20,214 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 13:12:20,214 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,216 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,216 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,217 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,217 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:12:20,217 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,217 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:12:20,217 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:12:20,217 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 13:12:20,217 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:12:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:20,218 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,218 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:12:20,218 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:20,218 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. started... 2023-07-19 13:12:20,218 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:20,221 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:20,221 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f33216d65e8b513e78c135a1a31420d5: 2023-07-19 13:12:20,221 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:20,221 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. started... 2023-07-19 13:12:20,221 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 13:12:20,221 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,221 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:20,221 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:20,221 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 13:12:20,223 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:12:20,221 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b31a12358b15b000476276caaa9bc30: 2023-07-19 13:12:20,223 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,223 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:20,223 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:12:20,226 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:20,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:12:20,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:20,227 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:12:20,239 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. completed. 2023-07-19 13:12:20,239 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,239 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. completed. 2023-07-19 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 13:12:20,239 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,240 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 13:12:20,240 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:12:20,241 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,241 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 13:12:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:20,241 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:20,242 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 13:12:20,242 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,242 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 13:12:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:20,242 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:20,243 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 13:12:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:20,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40427,1689772233020': 2023-07-19 13:12:20,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 13:12:20,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:20,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:20,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:20,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:20,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40947,1689772233100': 2023-07-19 13:12:20,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 13:12:20,257 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 13:12:20,257 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:12:20,257 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:12:20,257 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,257 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:12:20,260 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,260 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,260 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:20,260 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,261 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,261 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:20,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:20,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:20,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:20,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:20,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:20,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:20,262 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,262 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,263 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,263 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,265 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,266 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,266 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,269 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,269 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,269 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,269 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,270 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,270 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,270 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:20,270 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:20,270 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:20,270 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:20,270 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,270 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:20,272 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:20,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-19 13:12:20,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:20,272 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:20,270 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,273 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-19 13:12:20,270 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:20,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:20,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:20,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:20,272 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 13:12:20,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 13:12:20,273 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:20,274 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:20,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,427 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:20,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:12:20,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:20,428 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 13:12:20,433 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 13:12:20,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,434 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689772340125Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689772340323 (+198 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689772340323Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689772340324 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689772340339 (+15 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689772340397 (+58 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689772340433 (+36 ms) 2023-07-19 13:12:20,437 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 13:12:20,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 308 msec 2023-07-19 13:12:20,729 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:20,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:12:20,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:12:20,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40947] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:12:20,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40427] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:12:20,742 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 13:12:20,742 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:20,743 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:12:20,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:12:20,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772340755 (current time:1689772340755). 2023-07-19 13:12:20,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:12:20,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x417a03b5 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:20,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37d9d189, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:20,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:20,771 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:20,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x417a03b5 to 127.0.0.1:64840 2023-07-19 13:12:20,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:20,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x6b1e29df to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:20,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a68f8a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:20,786 DEBUG [hconnection-0x3442bff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:20,790 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:20,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b1e29df to 127.0.0.1:64840 2023-07-19 13:12:20,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:20,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 13:12:20,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:12:20,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:12:20,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:12:20,804 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:12:20,804 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689772940804 2023-07-19 13:12:20,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:12:20,804 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 13:12:20,806 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:12:20,806 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:12:20,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 13:12:20,812 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:12:20,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-19 13:12:20,815 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 13:12:20,815 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689772940815 2023-07-19 13:12:20,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,849 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-19 13:12:20,849 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:20,850 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 13:12:20,850 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 13:12:20,906 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,906 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,906 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:20,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:12:20,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:20,908 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:12:20,912 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:20,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:20,913 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:20,913 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,912 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:20,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:20,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:20,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,913 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,914 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,915 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,915 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:12:20,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 13:12:20,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 13:12:20,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 13:12:20,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 13:12:20,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,917 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 13:12:20,916 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 13:12:20,917 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,917 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 13:12:20,917 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:20,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,919 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 13:12:20,919 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:20,928 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 13:12:20,928 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,928 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 13:12:20,928 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 13:12:20,928 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 13:12:20,928 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 13:12:20,928 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:20,928 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 13:12:20,928 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 13:12:20,932 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 13:12:20,932 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 13:12:20,932 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 13:12:20,934 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:20,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:20,935 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,935 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,935 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,935 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:20,935 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,936 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:20,936 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,936 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:20,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:20,936 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,936 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:20,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:20,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 13:12:20,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2407351d[Count = 1] remaining members to acquire global barrier 2023-07-19 13:12:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:20,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:20,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:20,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:20,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 13:12:20,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2407351d[Count = 0] remaining members to acquire global barrier 2023-07-19 13:12:20,943 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 13:12:20,943 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,954 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,954 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,955 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:12:20,955 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:20,955 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:12:20,955 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:12:20,955 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 13:12:20,955 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:12:20,956 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:20,956 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:20,956 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:12:20,956 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:20,956 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:20,956 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:20,956 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. started... 2023-07-19 13:12:20,956 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:20,957 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:20,957 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:20,957 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. started... 2023-07-19 13:12:20,957 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b31a12358b15b000476276caaa9bc30 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 13:12:20,957 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f33216d65e8b513e78c135a1a31420d5 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 13:12:20,957 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 13:12:20,957 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:20,957 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 13:12:21,015 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307199272982dd6f34db0bfce67a161753407 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307199272982dd6f34db0bfce67a161753407 2023-07-19 13:12:21,018 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307198999263b810346a2815d0c9428320df0 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307198999263b810346a2815d0c9428320df0 2023-07-19 13:12:21,039 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/.tmp/cf/0ee1109efbdb4e188262c6c8826682ae 2023-07-19 13:12:21,043 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/.tmp/cf/a3312814697b491faa9bcfc957643677 2023-07-19 13:12:21,046 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/.tmp/cf/0ee1109efbdb4e188262c6c8826682ae as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/cf/0ee1109efbdb4e188262c6c8826682ae 2023-07-19 13:12:21,050 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/.tmp/cf/a3312814697b491faa9bcfc957643677 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/cf/a3312814697b491faa9bcfc957643677 2023-07-19 13:12:21,053 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/cf/0ee1109efbdb4e188262c6c8826682ae, entries=3, sequenceid=6, filesize=5.4 K 2023-07-19 13:12:21,055 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 5b31a12358b15b000476276caaa9bc30 in 98ms, sequenceid=6, compaction requested=false 2023-07-19 13:12:21,055 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 13:12:21,055 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b31a12358b15b000476276caaa9bc30: 2023-07-19 13:12:21,055 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,055 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:21,055 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/cf/0ee1109efbdb4e188262c6c8826682ae] hfiles 2023-07-19 13:12:21,055 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/cf/0ee1109efbdb4e188262c6c8826682ae for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,061 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/cf/a3312814697b491faa9bcfc957643677, entries=47, sequenceid=6, filesize=13.1 K 2023-07-19 13:12:21,062 INFO [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for f33216d65e8b513e78c135a1a31420d5 in 105ms, sequenceid=6, compaction requested=false 2023-07-19 13:12:21,064 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f33216d65e8b513e78c135a1a31420d5: 2023-07-19 13:12:21,065 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,066 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:21,066 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/cf/a3312814697b491faa9bcfc957643677] hfiles 2023-07-19 13:12:21,066 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/cf/a3312814697b491faa9bcfc957643677 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,083 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. completed. 2023-07-19 13:12:21,083 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:21,083 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:21,083 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:21,083 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,083 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 13:12:21,083 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:12:21,085 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,085 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 13:12:21,085 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:21,086 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 13:12:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:21,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:21,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:21,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:21,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:21,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:21,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40427,1689772233020': 2023-07-19 13:12:21,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 13:12:21,101 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. completed. 2023-07-19 13:12:21,101 DEBUG [rs(jenkins-hbase4.apache.org,40947,1689772233100)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:21,101 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:21,101 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:21,101 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:21,101 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 13:12:21,101 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:12:21,102 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:21,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:21,103 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 13:12:21,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:21,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:21,103 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:21,103 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 13:12:21,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:21,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:21,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:21,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:21,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:21,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:21,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:21,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40947,1689772233100': 2023-07-19 13:12:21,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 13:12:21,108 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 13:12:21,108 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:12:21,108 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:12:21,108 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,108 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:12:21,108 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:21,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:12:21,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:21,110 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 13:12:21,111 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,111 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:21,111 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,111 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:21,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:21,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,111 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:21,111 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,111 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:21,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:21,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:21,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:21,112 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,112 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:21,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,113 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:21,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:21,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:21,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:21,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:21,116 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,116 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:21,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,117 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:21,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:21,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:21,121 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:21,121 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:21,121 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:21,121 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:21,121 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,121 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:21,121 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:21,121 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-19 13:12:21,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:21,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:21,121 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:21,121 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:21,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:21,123 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:21,124 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,124 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,124 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:21,124 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,124 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:21,124 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:21,124 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,124 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:21,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 13:12:21,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:21,121 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:21,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:21,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:21,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:21,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:21,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:21,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:21,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307198999263b810346a2815d0c9428320df0, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307199272982dd6f34db0bfce67a161753407] mob files 2023-07-19 13:12:21,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307198999263b810346a2815d0c9428320df0 2023-07-19 13:12:21,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307199272982dd6f34db0bfce67a161753407 2023-07-19 13:12:21,410 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:21,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:12:21,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:21,412 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 13:12:21,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:21,913 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:21,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:12:21,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:21,915 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-19 13:12:22,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 13:12:22,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:22,037 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:22,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689772340805Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689772341554 (+749 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689772341554Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689772341554Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689772341565 (+11 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689772341578 (+13 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689772342037 (+459 ms) 2023-07-19 13:12:22,043 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 13:12:22,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.2370 sec 2023-07-19 13:12:22,715 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0005_000001 (auth:SIMPLE) 2023-07-19 13:12:22,915 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:22,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:12:22,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:12:22,919 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772342919 2023-07-19 13:12:22,919 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42143, tgtDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772342919, rawTgtDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772342919, srcFsUri=hdfs://localhost:42143, srcDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:12:22,972 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:12:22,973 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1343342547_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772342919, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772342919/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:22,973 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5, snapshotDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-19 13:12:22,993 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772342919/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:23,168 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:23,169 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:23,170 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:23,170 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:23,872 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:12:24,458 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-6109517504338293770.jar 2023-07-19 13:12:24,459 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:24,459 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:24,549 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-8685004343163548442.jar 2023-07-19 13:12:24,550 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:24,550 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:24,550 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:24,551 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:24,551 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:24,552 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:24,552 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:12:24,553 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:12:24,554 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:12:24,554 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:12:24,555 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:12:24,555 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:12:24,556 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:12:24,556 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:12:24,557 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:12:24,557 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:12:24,558 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:24,559 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:24,560 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:12:24,560 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:24,560 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:24,561 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:12:24,562 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:12:26,438 WARN [Listener at jenkins-hbase4.apache.org/36809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:12:26,451 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-19 13:12:26,684 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:12:26,684 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:12:26,722 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0006_000001 (auth:SIMPLE) 2023-07-19 13:12:32,033 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0006_000001 (auth:SIMPLE) 2023-07-19 13:12:34,998 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:12:34,999 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:12:35,005 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:35,005 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:12:35,006 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:12:35,006 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583241713_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:35,007 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 13:12:35,007 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 13:12:35,007 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583241713_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772342919/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772342919/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:35,007 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772342919/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 13:12:35,007 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772342919/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 13:12:35,013 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 13:12:35,023 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772355023"}]},"ts":"1689772355023"} 2023-07-19 13:12:35,024 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 13:12:35,028 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-19 13:12:35,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b31a12358b15b000476276caaa9bc30, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f33216d65e8b513e78c135a1a31420d5, UNASSIGN}] 2023-07-19 13:12:35,030 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b31a12358b15b000476276caaa9bc30, UNASSIGN 2023-07-19 13:12:35,032 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f33216d65e8b513e78c135a1a31420d5, UNASSIGN 2023-07-19 13:12:35,033 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f33216d65e8b513e78c135a1a31420d5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:35,033 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5b31a12358b15b000476276caaa9bc30, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:35,033 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772355033"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772355033"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772355033"}]},"ts":"1689772355033"} 2023-07-19 13:12:35,033 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772355033"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772355033"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772355033"}]},"ts":"1689772355033"} 2023-07-19 13:12:35,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure f33216d65e8b513e78c135a1a31420d5, server=jenkins-hbase4.apache.org,40947,1689772233100}] 2023-07-19 13:12:35,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 5b31a12358b15b000476276caaa9bc30, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:12:35,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 13:12:35,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:35,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f33216d65e8b513e78c135a1a31420d5, disabling compactions & flushes 2023-07-19 13:12:35,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:35,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:35,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. after waiting 0 ms 2023-07-19 13:12:35,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:35,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:35,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b31a12358b15b000476276caaa9bc30, disabling compactions & flushes 2023-07-19 13:12:35,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:35,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:35,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. after waiting 0 ms 2023-07-19 13:12:35,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:35,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:12:35,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:35,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5. 2023-07-19 13:12:35,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f33216d65e8b513e78c135a1a31420d5: 2023-07-19 13:12:35,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:12:35,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:35,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30. 2023-07-19 13:12:35,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b31a12358b15b000476276caaa9bc30: 2023-07-19 13:12:35,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:35,209 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f33216d65e8b513e78c135a1a31420d5, regionState=CLOSED 2023-07-19 13:12:35,210 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772355209"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772355209"}]},"ts":"1689772355209"} 2023-07-19 13:12:35,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:35,211 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5b31a12358b15b000476276caaa9bc30, regionState=CLOSED 2023-07-19 13:12:35,211 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772355211"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772355211"}]},"ts":"1689772355211"} 2023-07-19 13:12:35,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-19 13:12:35,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure f33216d65e8b513e78c135a1a31420d5, server=jenkins-hbase4.apache.org,40947,1689772233100 in 177 msec 2023-07-19 13:12:35,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-19 13:12:35,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f33216d65e8b513e78c135a1a31420d5, UNASSIGN in 185 msec 2023-07-19 13:12:35,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 5b31a12358b15b000476276caaa9bc30, server=jenkins-hbase4.apache.org,40427,1689772233020 in 177 msec 2023-07-19 13:12:35,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-19 13:12:35,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b31a12358b15b000476276caaa9bc30, UNASSIGN in 192 msec 2023-07-19 13:12:35,224 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772355224"}]},"ts":"1689772355224"} 2023-07-19 13:12:35,225 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 13:12:35,227 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-19 13:12:35,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 214 msec 2023-07-19 13:12:35,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 13:12:35,326 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-19 13:12:35,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,330 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,331 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,337 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:35,337 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,337 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:35,341 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/recovered.edits] 2023-07-19 13:12:35,341 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,341 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,341 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,341 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,342 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/recovered.edits] 2023-07-19 13:12:35,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 13:12:35,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 13:12:35,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 13:12:35,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 13:12:35,344 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,344 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:35,344 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,344 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:35,344 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,344 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:35,344 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,344 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:35,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 13:12:35,348 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/cf/a3312814697b491faa9bcfc957643677 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/cf/a3312814697b491faa9bcfc957643677 2023-07-19 13:12:35,354 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/cf/0ee1109efbdb4e188262c6c8826682ae to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/cf/0ee1109efbdb4e188262c6c8826682ae 2023-07-19 13:12:35,357 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/recovered.edits/9.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5/recovered.edits/9.seqid 2023-07-19 13:12:35,357 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f33216d65e8b513e78c135a1a31420d5 2023-07-19 13:12:35,361 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/recovered.edits/9.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30/recovered.edits/9.seqid 2023-07-19 13:12:35,362 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b31a12358b15b000476276caaa9bc30 2023-07-19 13:12:35,362 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 13:12:35,362 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-19 13:12:35,363 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-19 13:12:35,366 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307198999263b810346a2815d0c9428320df0 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307198999263b810346a2815d0c9428320df0 2023-07-19 13:12:35,368 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307199272982dd6f34db0bfce67a161753407 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307199272982dd6f34db0bfce67a161753407 2023-07-19 13:12:35,368 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-19 13:12:35,370 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,372 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-19 13:12:35,374 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-19 13:12:35,375 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,375 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-19 13:12:35,376 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772355375"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:35,376 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772355375"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:35,377 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 13:12:35,377 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b31a12358b15b000476276caaa9bc30, NAME => 'testtb-testEmptyExportFileSystemState,,1689772339401.5b31a12358b15b000476276caaa9bc30.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f33216d65e8b513e78c135a1a31420d5, NAME => 'testtb-testEmptyExportFileSystemState,1,1689772339401.f33216d65e8b513e78c135a1a31420d5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 13:12:35,377 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-19 13:12:35,377 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772355377"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:35,379 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-19 13:12:35,381 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:35,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 54 msec 2023-07-19 13:12:35,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 13:12:35,447 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-19 13:12:35,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-19 13:12:35,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:35,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-19 13:12:35,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:35,496 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 757) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-145408019_1 at /127.0.0.1:49110 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:34945 from appattempt_1689772242192_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:40454 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4910 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:38199 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:32802 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1b9cf62d-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-145408019_1 at /127.0.0.1:32768 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583241713_17 at /127.0.0.1:49126 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=495 (was 483) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=1933 (was 1922) - AvailableMemoryMB LEAK? - 2023-07-19 13:12:35,496 WARN [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-19 13:12:35,529 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=495, ProcessCount=185, AvailableMemoryMB=1927 2023-07-19 13:12:35,530 WARN [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-19 13:12:35,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 13:12:35,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:35,536 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:12:35,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-19 13:12:35,537 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:12:35,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 13:12:35,541 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:35,541 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:35,542 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8 empty. 2023-07-19 13:12:35,542 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c empty. 2023-07-19 13:12:35,542 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:35,542 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:35,542 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 13:12:35,575 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-19 13:12:35,576 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => a7dfbe2992ba1222fa7162349297494c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:12:35,577 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0cd809ae60bfd7c4cc02e94c5a150ce8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp 2023-07-19 13:12:35,626 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:35,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing a7dfbe2992ba1222fa7162349297494c, disabling compactions & flushes 2023-07-19 13:12:35,627 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:35,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:35,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. after waiting 0 ms 2023-07-19 13:12:35,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:35,627 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:35,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for a7dfbe2992ba1222fa7162349297494c: 2023-07-19 13:12:35,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 13:12:35,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 13:12:36,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:36,027 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 0cd809ae60bfd7c4cc02e94c5a150ce8, disabling compactions & flushes 2023-07-19 13:12:36,028 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:36,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:36,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. after waiting 0 ms 2023-07-19 13:12:36,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:36,028 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:36,028 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 0cd809ae60bfd7c4cc02e94c5a150ce8: 2023-07-19 13:12:36,033 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:12:36,034 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772356034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772356034"}]},"ts":"1689772356034"} 2023-07-19 13:12:36,034 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772356034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772356034"}]},"ts":"1689772356034"} 2023-07-19 13:12:36,037 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:12:36,037 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:12:36,038 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772356038"}]},"ts":"1689772356038"} 2023-07-19 13:12:36,039 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-19 13:12:36,043 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:12:36,044 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:12:36,044 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:12:36,044 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:12:36,044 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:12:36,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7dfbe2992ba1222fa7162349297494c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0cd809ae60bfd7c4cc02e94c5a150ce8, ASSIGN}] 2023-07-19 13:12:36,047 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0cd809ae60bfd7c4cc02e94c5a150ce8, ASSIGN 2023-07-19 13:12:36,048 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7dfbe2992ba1222fa7162349297494c, ASSIGN 2023-07-19 13:12:36,050 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0cd809ae60bfd7c4cc02e94c5a150ce8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40427,1689772233020; forceNewPlan=false, retain=false 2023-07-19 13:12:36,051 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7dfbe2992ba1222fa7162349297494c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41603,1689772232926; forceNewPlan=false, retain=false 2023-07-19 13:12:36,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 13:12:36,200 INFO [jenkins-hbase4:33091] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:12:36,203 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a7dfbe2992ba1222fa7162349297494c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:36,203 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0cd809ae60bfd7c4cc02e94c5a150ce8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,203 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772356203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772356203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772356203"}]},"ts":"1689772356203"} 2023-07-19 13:12:36,204 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772356203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772356203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772356203"}]},"ts":"1689772356203"} 2023-07-19 13:12:36,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure a7dfbe2992ba1222fa7162349297494c, server=jenkins-hbase4.apache.org,41603,1689772232926}] 2023-07-19 13:12:36,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 0cd809ae60bfd7c4cc02e94c5a150ce8, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:12:36,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:36,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a7dfbe2992ba1222fa7162349297494c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 13:12:36,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. service=AccessControlService 2023-07-19 13:12:36,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:36,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0cd809ae60bfd7c4cc02e94c5a150ce8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 13:12:36,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:12:36,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. service=AccessControlService 2023-07-19 13:12:36,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:36,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:36,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:12:36,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:36,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:36,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:36,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:36,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:36,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:36,365 INFO [StoreOpener-a7dfbe2992ba1222fa7162349297494c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:36,365 INFO [StoreOpener-0cd809ae60bfd7c4cc02e94c5a150ce8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:36,367 DEBUG [StoreOpener-a7dfbe2992ba1222fa7162349297494c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/cf 2023-07-19 13:12:36,367 DEBUG [StoreOpener-a7dfbe2992ba1222fa7162349297494c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/cf 2023-07-19 13:12:36,367 INFO [StoreOpener-a7dfbe2992ba1222fa7162349297494c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7dfbe2992ba1222fa7162349297494c columnFamilyName cf 2023-07-19 13:12:36,367 DEBUG [StoreOpener-0cd809ae60bfd7c4cc02e94c5a150ce8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/cf 2023-07-19 13:12:36,368 DEBUG [StoreOpener-0cd809ae60bfd7c4cc02e94c5a150ce8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/cf 2023-07-19 13:12:36,368 INFO [StoreOpener-0cd809ae60bfd7c4cc02e94c5a150ce8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0cd809ae60bfd7c4cc02e94c5a150ce8 columnFamilyName cf 2023-07-19 13:12:36,369 INFO [StoreOpener-a7dfbe2992ba1222fa7162349297494c-1] regionserver.HStore(310): Store=a7dfbe2992ba1222fa7162349297494c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:12:36,369 INFO [StoreOpener-0cd809ae60bfd7c4cc02e94c5a150ce8-1] regionserver.HStore(310): Store=0cd809ae60bfd7c4cc02e94c5a150ce8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:12:36,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:36,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:36,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:36,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:36,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:36,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:36,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:12:36,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:12:36,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0cd809ae60bfd7c4cc02e94c5a150ce8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66371722, jitterRate=-0.010984271764755249}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:12:36,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0cd809ae60bfd7c4cc02e94c5a150ce8: 2023-07-19 13:12:36,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a7dfbe2992ba1222fa7162349297494c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59491297, jitterRate=-0.11351059377193451}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:12:36,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a7dfbe2992ba1222fa7162349297494c: 2023-07-19 13:12:36,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c., pid=108, masterSystemTime=1689772356358 2023-07-19 13:12:36,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8., pid=109, masterSystemTime=1689772356359 2023-07-19 13:12:36,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:36,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:36,380 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a7dfbe2992ba1222fa7162349297494c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:36,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:36,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:36,380 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772356380"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772356380"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772356380"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772356380"}]},"ts":"1689772356380"} 2023-07-19 13:12:36,382 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0cd809ae60bfd7c4cc02e94c5a150ce8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,383 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772356382"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772356382"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772356382"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772356382"}]},"ts":"1689772356382"} 2023-07-19 13:12:36,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-19 13:12:36,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure a7dfbe2992ba1222fa7162349297494c, server=jenkins-hbase4.apache.org,41603,1689772232926 in 178 msec 2023-07-19 13:12:36,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-19 13:12:36,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 0cd809ae60bfd7c4cc02e94c5a150ce8, server=jenkins-hbase4.apache.org,40427,1689772233020 in 178 msec 2023-07-19 13:12:36,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7dfbe2992ba1222fa7162349297494c, ASSIGN in 341 msec 2023-07-19 13:12:36,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-19 13:12:36,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0cd809ae60bfd7c4cc02e94c5a150ce8, ASSIGN in 343 msec 2023-07-19 13:12:36,389 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:12:36,389 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772356389"}]},"ts":"1689772356389"} 2023-07-19 13:12:36,391 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-19 13:12:36,394 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:12:36,394 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-19 13:12:36,396 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 13:12:36,398 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:36,398 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:36,398 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:36,398 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:36,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:36,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:36,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:36,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:36,402 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 868 msec 2023-07-19 13:12:36,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 13:12:36,644 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-19 13:12:36,650 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,650 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:36,652 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:12:36,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 13:12:36,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772356690 (current time:1689772356690). 2023-07-19 13:12:36,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:12:36,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x2326f622 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:36,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c81b8ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:36,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:36,700 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:36,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2326f622 to 127.0.0.1:64840 2023-07-19 13:12:36,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:36,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x3621e625 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:36,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22229125, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:36,711 DEBUG [hconnection-0x23e52b63-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:36,714 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:36,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3621e625 to 127.0.0.1:64840 2023-07-19 13:12:36,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:36,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 13:12:36,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:12:36,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 13:12:36,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 13:12:36,724 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 13:12:36,725 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689772956725 2023-07-19 13:12:36,725 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 13:12:36,727 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:12:36,727 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:12:36,728 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 13:12:36,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 13:12:36,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-19 13:12:36,731 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 13:12:36,731 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689772956731 2023-07-19 13:12:36,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,768 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 13:12:36,768 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:36,770 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 13:12:36,770 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 13:12:36,772 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,772 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,773 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:36,773 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:36,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:36,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:36,773 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:36,773 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:36,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:36,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,774 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:36,774 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,775 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,775 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:12:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 13:12:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 13:12:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,775 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 13:12:36,775 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 13:12:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 13:12:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,776 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 13:12:36,779 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,779 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 13:12:36,779 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:36,780 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,780 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 13:12:36,780 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:36,780 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,780 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 13:12:36,780 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:36,784 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 13:12:36,784 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 13:12:36,784 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 13:12:36,785 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 13:12:36,785 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 13:12:36,785 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 13:12:36,785 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 13:12:36,785 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 13:12:36,785 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 13:12:36,792 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,793 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,793 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:36,793 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,793 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:36,793 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:36,794 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,794 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,794 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:36,794 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,794 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:36,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:36,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:36,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:36,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:36,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 13:12:36,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47d828ce[Count = 1] remaining members to acquire global barrier 2023-07-19 13:12:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:36,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:36,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 13:12:36,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47d828ce[Count = 0] remaining members to acquire global barrier 2023-07-19 13:12:36,801 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 13:12:36,801 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,804 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,804 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,805 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,805 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 13:12:36,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,805 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,805 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 13:12:36,805 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 13:12:36,805 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:12:36,805 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:36,805 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:36,806 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:36,806 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:12:36,806 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:36,806 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. started... 2023-07-19 13:12:36,806 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 13:12:36,813 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 13:12:36,813 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:36,813 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 13:12:36,819 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:36,822 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:36,822 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7dfbe2992ba1222fa7162349297494c: 2023-07-19 13:12:36,822 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. started... 2023-07-19 13:12:36,823 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,822 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:36,824 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0cd809ae60bfd7c4cc02e94c5a150ce8: 2023-07-19 13:12:36,824 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:36,824 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,824 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:12:36,825 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:36,825 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:12:36,827 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:36,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:36,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:36,831 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:12:36,865 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. completed. 2023-07-19 13:12:36,866 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:36,867 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:36,867 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:36,867 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,867 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 13:12:36,867 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:12:36,869 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,869 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 13:12:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:36,870 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:36,870 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 13:12:36,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:36,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:36,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:36,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:36,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:36,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:36,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:36,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:36,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40427,1689772233020': 2023-07-19 13:12:36,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 13:12:37,031 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:37,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:37,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:37,032 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 13:12:37,265 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. completed. 2023-07-19 13:12:37,266 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:37,266 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:37,266 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:37,266 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:37,266 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 13:12:37,266 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:12:37,268 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:37,268 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 13:12:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:37,268 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:37,268 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 13:12:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:37,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:37,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:37,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:37,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41603,1689772232926': 2023-07-19 13:12:37,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 13:12:37,274 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 13:12:37,274 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:12:37,274 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:12:37,274 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,274 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:12:37,276 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,276 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:37,276 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,277 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:37,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,277 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,277 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:37,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,277 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,277 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:37,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:37,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:37,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:37,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:37,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:37,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:37,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,278 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:37,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,279 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:37,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:37,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:37,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:37,281 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,281 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:37,281 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:37,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:37,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:37,286 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:37,286 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:37,286 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:37,286 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:37,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:37,286 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:37,286 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:37,287 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:37,287 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:37,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:37,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:37,287 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,287 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:37,287 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,287 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:37,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:37,287 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:37,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:37,287 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,287 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:37,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,288 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,288 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 13:12:37,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 13:12:37,296 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:37,296 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:37,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:37,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:37,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:37,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:37,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,333 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:37,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:37,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:37,334 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 13:12:37,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,447 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 13:12:37,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,447 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689772356725Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689772357316 (+591 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689772357316Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689772357316Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689772357320 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689772357347 (+27 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689772357447 (+100 ms) 2023-07-19 13:12:37,451 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 13:12:37,453 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 724 msec 2023-07-19 13:12:37,835 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:37,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:37,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:12:37,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40427] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:12:37,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41603] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:12:37,859 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,859 DEBUG [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:37,859 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:12:37,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 13:12:37,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772357878 (current time:1689772357878). 2023-07-19 13:12:37,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:12:37,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x55105470 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:37,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fa4d382, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:37,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:37,903 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:37,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55105470 to 127.0.0.1:64840 2023-07-19 13:12:37,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:37,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(139): Connect 0x28d77554 to 127.0.0.1:64840 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:37,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fb317ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:37,919 DEBUG [hconnection-0x6f2f35d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:37,920 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:37,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28d77554 to 127.0.0.1:64840 2023-07-19 13:12:37,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:37,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 13:12:37,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:12:37,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 13:12:37,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 13:12:37,933 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 13:12:37,934 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689772957934 2023-07-19 13:12:37,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 13:12:37,934 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,936 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:12:37,936 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:12:37,937 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 13:12:37,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 13:12:37,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-19 13:12:37,939 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 13:12:37,940 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689772957940 2023-07-19 13:12:37,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:37,964 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 13:12:37,964 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:37,966 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 13:12:37,966 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 13:12:38,031 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,032 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,034 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,034 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:38,034 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:38,034 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:38,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:38,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:38,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:38,034 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,035 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,035 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,035 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:12:38,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 13:12:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 13:12:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 13:12:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,036 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,036 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 13:12:38,036 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 13:12:38,036 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 13:12:38,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,037 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 13:12:38,037 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:38,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:38,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:38,037 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:12:38,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,040 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 13:12:38,040 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 13:12:38,040 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:38,040 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 13:12:38,040 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 13:12:38,041 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:38,041 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 13:12:38,042 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 13:12:38,043 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 13:12:38,043 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 13:12:38,043 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 13:12:38,043 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 13:12:38,042 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40947,1689772233100' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 13:12:38,044 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,044 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:38,044 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,045 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,045 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,045 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:38,045 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:38,045 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,045 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:38,046 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,046 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:38,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:38,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:38,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:38,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41603,1689772232926' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 13:12:38,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@503fdd9c[Count = 1] remaining members to acquire global barrier 2023-07-19 13:12:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:38,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40427,1689772233020' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 13:12:38,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@503fdd9c[Count = 0] remaining members to acquire global barrier 2023-07-19 13:12:38,050 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 13:12:38,050 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,057 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,057 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,057 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,057 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 13:12:38,057 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 13:12:38,057 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,057 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:38,058 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:38,058 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 13:12:38,058 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:38,058 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 13:12:38,058 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. started... 2023-07-19 13:12:38,058 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40947,1689772233100' in zk 2023-07-19 13:12:38,058 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,058 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:12:38,058 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a7dfbe2992ba1222fa7162349297494c 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-19 13:12:38,060 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 13:12:38,060 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:38,060 DEBUG [member: 'jenkins-hbase4.apache.org,40947,1689772233100' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 13:12:38,062 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:38,065 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:38,065 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. started... 2023-07-19 13:12:38,065 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:38,065 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0cd809ae60bfd7c4cc02e94c5a150ce8 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-19 13:12:38,114 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071963c41506b3ea4252b8f42922ad5b10c1 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071963c41506b3ea4252b8f42922ad5b10c1 2023-07-19 13:12:38,146 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719eb3717c1519141a380f77a3ae2d61c2d to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719eb3717c1519141a380f77a3ae2d61c2d 2023-07-19 13:12:38,163 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/.tmp/cf/6faef55b159b430e9b779a9aca9b7e38 2023-07-19 13:12:38,183 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/.tmp/cf/6faef55b159b430e9b779a9aca9b7e38 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/cf/6faef55b159b430e9b779a9aca9b7e38 2023-07-19 13:12:38,192 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/cf/6faef55b159b430e9b779a9aca9b7e38, entries=4, sequenceid=6, filesize=5.6 K 2023-07-19 13:12:38,193 INFO [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for a7dfbe2992ba1222fa7162349297494c in 135ms, sequenceid=6, compaction requested=false 2023-07-19 13:12:38,193 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-19 13:12:38,194 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7dfbe2992ba1222fa7162349297494c: 2023-07-19 13:12:38,194 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,194 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:38,194 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/cf/6faef55b159b430e9b779a9aca9b7e38] hfiles 2023-07-19 13:12:38,195 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/cf/6faef55b159b430e9b779a9aca9b7e38 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,217 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/.tmp/cf/6ac7963f9a7d4a018f05c3353112c0bf 2023-07-19 13:12:38,237 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:38,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:38,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:38,239 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 13:12:38,241 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/.tmp/cf/6ac7963f9a7d4a018f05c3353112c0bf as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/cf/6ac7963f9a7d4a018f05c3353112c0bf 2023-07-19 13:12:38,251 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/cf/6ac7963f9a7d4a018f05c3353112c0bf, entries=46, sequenceid=6, filesize=13.2 K 2023-07-19 13:12:38,252 INFO [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 0cd809ae60bfd7c4cc02e94c5a150ce8 in 187ms, sequenceid=6, compaction requested=false 2023-07-19 13:12:38,256 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0cd809ae60bfd7c4cc02e94c5a150ce8: 2023-07-19 13:12:38,256 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,256 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:38,256 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/cf/6ac7963f9a7d4a018f05c3353112c0bf] hfiles 2023-07-19 13:12:38,256 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/cf/6ac7963f9a7d4a018f05c3353112c0bf for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,283 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. completed. 2023-07-19 13:12:38,283 DEBUG [rs(jenkins-hbase4.apache.org,41603,1689772232926)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:38,283 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:38,283 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:38,283 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,283 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 13:12:38,283 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41603,1689772232926' in zk 2023-07-19 13:12:38,285 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,285 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 13:12:38,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:38,285 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:38,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:38,286 DEBUG [member: 'jenkins-hbase4.apache.org,41603,1689772232926' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 13:12:38,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:38,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:38,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:38,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:38,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41603,1689772232926': 2023-07-19 13:12:38,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41603,1689772232926' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 13:12:38,345 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. completed. 2023-07-19 13:12:38,345 DEBUG [rs(jenkins-hbase4.apache.org,40427,1689772233020)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:38,345 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:38,345 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:38,345 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,345 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 13:12:38,345 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40427,1689772233020' in zk 2023-07-19 13:12:38,347 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,347 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 13:12:38,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:38,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:38,347 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:38,347 DEBUG [member: 'jenkins-hbase4.apache.org,40427,1689772233020' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 13:12:38,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:38,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:38,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:38,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:38,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:38,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40427,1689772233020': 2023-07-19 13:12:38,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40427,1689772233020' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 13:12:38,354 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 13:12:38,354 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:12:38,354 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:12:38,354 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,354 INFO [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:12:38,357 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,357 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,357 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,357 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:38,357 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:38,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,358 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:38,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:38,358 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:38,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:38,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:38,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:38,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:38,360 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,360 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:38,361 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:38,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:38,363 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,363 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:38,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,364 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,372 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:38,372 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,372 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:38,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:38,372 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:38,372 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:38,372 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,372 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 13:12:38,372 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:38,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:38,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:38,372 DEBUG [(jenkins-hbase4.apache.org,33091,1689772231406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:38,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:38,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:38,372 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:38,372 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:38,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719eb3717c1519141a380f77a3ae2d61c2d, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071963c41506b3ea4252b8f42922ad5b10c1] mob files 2023-07-19 13:12:38,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:38,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:38,375 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:38,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719eb3717c1519141a380f77a3ae2d61c2d 2023-07-19 13:12:38,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:38,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071963c41506b3ea4252b8f42922ad5b10c1 2023-07-19 13:12:38,375 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:38,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:38,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:38,376 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,376 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:38,376 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,376 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:12:38,376 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:38,376 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,376 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 13:12:38,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,528 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689772357934Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689772358384 (+450 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689772358384Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689772358384Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689772358400 (+16 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689772358435 (+35 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689772358527 (+92 ms) 2023-07-19 13:12:38,532 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 13:12:38,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 597 msec 2023-07-19 13:12:38,539 DEBUG [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:38,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:38,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:12:38,541 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772358541 2023-07-19 13:12:38,541 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42143, tgtDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772358541, rawTgtDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772358541, srcFsUri=hdfs://localhost:42143, srcDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:12:38,569 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5 2023-07-19 13:12:38,569 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2133870182_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772358541, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772358541/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,569 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42143, inputRoot=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5, snapshotDir=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-19 13:12:38,599 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772358541/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:38,683 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:38,684 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:38,684 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:38,685 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:39,430 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0006_000001 (auth:SIMPLE) 2023-07-19 13:12:39,880 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-8274291854683409086.jar 2023-07-19 13:12:39,881 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:39,881 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:39,969 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/hadoop-8923142424114212829.jar 2023-07-19 13:12:39,970 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:39,971 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:39,971 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:39,972 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:39,972 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:39,973 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:39,973 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:12:39,974 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:12:39,974 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:12:39,975 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:12:39,975 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:12:39,975 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:12:39,976 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:12:39,976 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:12:39,976 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:12:39,977 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:12:39,977 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:39,978 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:39,978 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:12:39,979 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:39,979 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:39,979 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:12:39,980 DEBUG [Listener at jenkins-hbase4.apache.org/36809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:12:40,565 WARN [Listener at jenkins-hbase4.apache.org/36809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:12:40,568 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-19 13:12:40,570 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-19 13:12:40,640 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:12:40,644 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:12:40,810 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:12:41,024 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0007_000001 (auth:SIMPLE) 2023-07-19 13:12:47,420 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0007_000001 (auth:SIMPLE) 2023-07-19 13:12:49,697 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0007_000001 (auth:SIMPLE) 2023-07-19 13:12:53,455 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0007_000001 (auth:SIMPLE) 2023-07-19 13:12:54,779 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:12:54,779 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:12:54,797 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:54,797 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:12:54,798 INFO [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:12:54,798 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583241713_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:54,799 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 13:12:54,799 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 13:12:54,799 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583241713_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772358541/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772358541/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:54,799 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772358541/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 13:12:54,799 DEBUG [Listener at jenkins-hbase4.apache.org/36809] snapshot.TestExportSnapshot(367): hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/export-test/export-1689772358541/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 13:12:54,806 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:54,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:54,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:54,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 13:12:54,812 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772374812"}]},"ts":"1689772374812"} 2023-07-19 13:12:54,814 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-19 13:12:54,816 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-19 13:12:54,817 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7dfbe2992ba1222fa7162349297494c, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0cd809ae60bfd7c4cc02e94c5a150ce8, UNASSIGN}] 2023-07-19 13:12:54,819 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0cd809ae60bfd7c4cc02e94c5a150ce8, UNASSIGN 2023-07-19 13:12:54,819 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7dfbe2992ba1222fa7162349297494c, UNASSIGN 2023-07-19 13:12:54,820 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0cd809ae60bfd7c4cc02e94c5a150ce8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:12:54,820 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a7dfbe2992ba1222fa7162349297494c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:12:54,820 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772374820"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772374820"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772374820"}]},"ts":"1689772374820"} 2023-07-19 13:12:54,820 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772374820"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772374820"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772374820"}]},"ts":"1689772374820"} 2023-07-19 13:12:54,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 0cd809ae60bfd7c4cc02e94c5a150ce8, server=jenkins-hbase4.apache.org,40427,1689772233020}] 2023-07-19 13:12:54,823 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure a7dfbe2992ba1222fa7162349297494c, server=jenkins-hbase4.apache.org,41603,1689772232926}] 2023-07-19 13:12:54,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 13:12:54,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:54,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:54,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0cd809ae60bfd7c4cc02e94c5a150ce8, disabling compactions & flushes 2023-07-19 13:12:54,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a7dfbe2992ba1222fa7162349297494c, disabling compactions & flushes 2023-07-19 13:12:54,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:54,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:54,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:54,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:54,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. after waiting 0 ms 2023-07-19 13:12:54,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:54,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. after waiting 0 ms 2023-07-19 13:12:54,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:54,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:12:54,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:12:54,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:54,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:54,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8. 2023-07-19 13:12:54,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c. 2023-07-19 13:12:54,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0cd809ae60bfd7c4cc02e94c5a150ce8: 2023-07-19 13:12:54,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a7dfbe2992ba1222fa7162349297494c: 2023-07-19 13:12:54,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:54,990 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a7dfbe2992ba1222fa7162349297494c, regionState=CLOSED 2023-07-19 13:12:54,990 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772374990"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772374990"}]},"ts":"1689772374990"} 2023-07-19 13:12:54,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:54,991 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0cd809ae60bfd7c4cc02e94c5a150ce8, regionState=CLOSED 2023-07-19 13:12:54,991 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772374991"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772374991"}]},"ts":"1689772374991"} 2023-07-19 13:12:54,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-19 13:12:54,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure a7dfbe2992ba1222fa7162349297494c, server=jenkins-hbase4.apache.org,41603,1689772232926 in 168 msec 2023-07-19 13:12:54,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-19 13:12:54,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 0cd809ae60bfd7c4cc02e94c5a150ce8, server=jenkins-hbase4.apache.org,40427,1689772233020 in 170 msec 2023-07-19 13:12:54,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a7dfbe2992ba1222fa7162349297494c, UNASSIGN in 176 msec 2023-07-19 13:12:54,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-19 13:12:54,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0cd809ae60bfd7c4cc02e94c5a150ce8, UNASSIGN in 176 msec 2023-07-19 13:12:54,995 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772374995"}]},"ts":"1689772374995"} 2023-07-19 13:12:54,996 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-19 13:12:54,998 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-19 13:12:54,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 191 msec 2023-07-19 13:12:55,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 13:12:55,114 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-19 13:12:55,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,118 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,119 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,123 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40427] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,127 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:55,127 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:55,127 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,127 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,127 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,127 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 13:12:55,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 13:12:55,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 13:12:55,128 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 13:12:55,129 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,129 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:55,129 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,129 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,129 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:55,129 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:55,130 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,130 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:55,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 13:12:55,130 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/recovered.edits] 2023-07-19 13:12:55,131 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/cf, FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/recovered.edits] 2023-07-19 13:12:55,135 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/cf/6faef55b159b430e9b779a9aca9b7e38 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/cf/6faef55b159b430e9b779a9aca9b7e38 2023-07-19 13:12:55,135 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/cf/6ac7963f9a7d4a018f05c3353112c0bf to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/cf/6ac7963f9a7d4a018f05c3353112c0bf 2023-07-19 13:12:55,137 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/recovered.edits/9.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c/recovered.edits/9.seqid 2023-07-19 13:12:55,138 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/recovered.edits/9.seqid to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8/recovered.edits/9.seqid 2023-07-19 13:12:55,138 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a7dfbe2992ba1222fa7162349297494c 2023-07-19 13:12:55,138 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0cd809ae60bfd7c4cc02e94c5a150ce8 2023-07-19 13:12:55,138 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 13:12:55,138 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-19 13:12:55,139 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-19 13:12:55,142 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719eb3717c1519141a380f77a3ae2d61c2d to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719eb3717c1519141a380f77a3ae2d61c2d 2023-07-19 13:12:55,143 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071963c41506b3ea4252b8f42922ad5b10c1 to hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071963c41506b3ea4252b8f42922ad5b10c1 2023-07-19 13:12:55,143 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-19 13:12:55,145 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,147 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-19 13:12:55,149 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-19 13:12:55,150 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,150 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-19 13:12:55,150 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772375150"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:55,150 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772375150"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:55,152 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 13:12:55,152 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a7dfbe2992ba1222fa7162349297494c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689772355531.a7dfbe2992ba1222fa7162349297494c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0cd809ae60bfd7c4cc02e94c5a150ce8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689772355531.0cd809ae60bfd7c4cc02e94c5a150ce8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 13:12:55,152 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-19 13:12:55,152 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772375152"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:55,153 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-19 13:12:55,155 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 40 msec 2023-07-19 13:12:55,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 13:12:55,232 INFO [Listener at jenkins-hbase4.apache.org/36809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-19 13:12:55,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 13:12:55,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 13:12:55,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33091] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:55,267 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761 (was 763), OpenFileDescriptor=895 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=480 (was 495), ProcessCount=182 (was 185), AvailableMemoryMB=1572 (was 1927) 2023-07-19 13:12:55,267 WARN [Listener at jenkins-hbase4.apache.org/36809] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-19 13:12:55,267 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-19 13:12:55,279 INFO [Listener at jenkins-hbase4.apache.org/36809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 13:12:59,639 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772242192_0007_000001 (auth:SIMPLE) 2023-07-19 13:13:00,564 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:13:09,417 INFO [Listener at jenkins-hbase4.apache.org/36809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 13:13:23,543 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 13:13:23,544 INFO [Listener at jenkins-hbase4.apache.org/36809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 13:13:23,654 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-19 13:13:23,672 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-19 13:13:23,674 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 13:13:23,691 INFO [Listener at jenkins-hbase4.apache.org/36809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 13:13:23,795 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 13:13:23,795 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-19 13:13:23,795 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 13:13:23,795 INFO [Listener at jenkins-hbase4.apache.org/36809] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 13:13:23,795 DEBUG [Listener at jenkins-hbase4.apache.org/36809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x783bbc0f to 127.0.0.1:64840 2023-07-19 13:13:23,796 DEBUG [Listener at jenkins-hbase4.apache.org/36809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:23,796 DEBUG [Listener at jenkins-hbase4.apache.org/36809] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 13:13:23,796 DEBUG [Listener at jenkins-hbase4.apache.org/36809] util.JVMClusterUtil(257): Found active master hash=656295089, stopped=false 2023-07-19 13:13:23,796 DEBUG [Listener at jenkins-hbase4.apache.org/36809] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:23,796 DEBUG [Listener at jenkins-hbase4.apache.org/36809] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 13:13:23,796 INFO [Listener at jenkins-hbase4.apache.org/36809] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33091,1689772231406 2023-07-19 13:13:23,798 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 13:13:23,798 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 13:13:23,798 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 13:13:23,798 INFO [Listener at jenkins-hbase4.apache.org/36809] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 13:13:23,798 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 13:13:23,798 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:13:23,798 DEBUG [Listener at jenkins-hbase4.apache.org/36809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d9c77e7 to 127.0.0.1:64840 2023-07-19 13:13:23,798 DEBUG [Listener at jenkins-hbase4.apache.org/36809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:23,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:13:23,798 INFO [Listener at jenkins-hbase4.apache.org/36809] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41603,1689772232926' ***** 2023-07-19 13:13:23,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:13:23,799 DEBUG [Listener at jenkins-hbase4.apache.org/36809] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:23,799 INFO [Listener at jenkins-hbase4.apache.org/36809] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 13:13:23,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:13:23,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:13:23,799 INFO [RS:0;jenkins-hbase4:41603] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 13:13:23,799 INFO [Listener at jenkins-hbase4.apache.org/36809] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40427,1689772233020' ***** 2023-07-19 13:13:23,799 INFO [RS:0;jenkins-hbase4:41603] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 13:13:23,800 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 13:13:23,800 INFO [RS:0;jenkins-hbase4:41603] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 13:13:23,799 DEBUG [Listener at jenkins-hbase4.apache.org/36809] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:23,800 INFO [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:13:23,800 INFO [Listener at jenkins-hbase4.apache.org/36809] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 13:13:23,800 DEBUG [RS:0;jenkins-hbase4:41603] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fe1d641 to 127.0.0.1:64840 2023-07-19 13:13:23,800 INFO [Listener at jenkins-hbase4.apache.org/36809] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40947,1689772233100' ***** 2023-07-19 13:13:23,800 INFO [RS:1;jenkins-hbase4:40427] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 13:13:23,800 DEBUG [RS:0;jenkins-hbase4:41603] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:23,800 INFO [RS:1;jenkins-hbase4:40427] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 13:13:23,801 INFO [RS:1;jenkins-hbase4:40427] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 13:13:23,802 INFO [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(3305): Received CLOSE for b5b7aa3312a3928563d14ec9b4ef3877 2023-07-19 13:13:23,800 DEBUG [Listener at jenkins-hbase4.apache.org/36809] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:23,803 INFO [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:13:23,803 DEBUG [RS:1;jenkins-hbase4:40427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5366c819 to 127.0.0.1:64840 2023-07-19 13:13:23,803 DEBUG [RS:1;jenkins-hbase4:40427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:23,802 INFO [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41603,1689772232926; all regions closed. 2023-07-19 13:13:23,806 INFO [RS:1;jenkins-hbase4:40427] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 13:13:23,802 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 13:13:23,809 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 13:13:23,806 INFO [RS:1;jenkins-hbase4:40427] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 13:13:23,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5b7aa3312a3928563d14ec9b4ef3877, disabling compactions & flushes 2023-07-19 13:13:23,803 INFO [Listener at jenkins-hbase4.apache.org/36809] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 13:13:23,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. 2023-07-19 13:13:23,810 INFO [RS:1;jenkins-hbase4:40427] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 13:13:23,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. 2023-07-19 13:13:23,810 INFO [RS:2;jenkins-hbase4:40947] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 13:13:23,810 INFO [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 13:13:23,810 INFO [RS:2;jenkins-hbase4:40947] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 13:13:23,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. after waiting 0 ms 2023-07-19 13:13:23,810 INFO [RS:2;jenkins-hbase4:40947] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 13:13:23,810 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 13:13:23,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. 2023-07-19 13:13:23,811 INFO [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(3305): Received CLOSE for 8c0c372c89d9dea857cad4b5ddd06c11 2023-07-19 13:13:23,810 INFO [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-19 13:13:23,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b5b7aa3312a3928563d14ec9b4ef3877 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-19 13:13:23,816 DEBUG [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, b5b7aa3312a3928563d14ec9b4ef3877=hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877.} 2023-07-19 13:13:23,811 INFO [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:13:23,816 DEBUG [RS:2;jenkins-hbase4:40947] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c837e85 to 127.0.0.1:64840 2023-07-19 13:13:23,816 DEBUG [RS:2;jenkins-hbase4:40947] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:23,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8c0c372c89d9dea857cad4b5ddd06c11, disabling compactions & flushes 2023-07-19 13:13:23,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. 2023-07-19 13:13:23,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. 2023-07-19 13:13:23,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. after waiting 0 ms 2023-07-19 13:13:23,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. 2023-07-19 13:13:23,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8c0c372c89d9dea857cad4b5ddd06c11 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 13:13:23,815 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 13:13:23,819 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 13:13:23,817 INFO [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 13:13:23,819 DEBUG [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(1504): Waiting on 1588230740, b5b7aa3312a3928563d14ec9b4ef3877 2023-07-19 13:13:23,819 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 13:13:23,819 DEBUG [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(1478): Online Regions={8c0c372c89d9dea857cad4b5ddd06c11=hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11.} 2023-07-19 13:13:23,820 DEBUG [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(1504): Waiting on 8c0c372c89d9dea857cad4b5ddd06c11 2023-07-19 13:13:23,819 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 13:13:23,820 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 13:13:23,820 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-19 13:13:23,840 DEBUG [RS:0;jenkins-hbase4:41603] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/oldWALs 2023-07-19 13:13:23,840 INFO [RS:0;jenkins-hbase4:41603] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41603%2C1689772232926:(num 1689772235309) 2023-07-19 13:13:23,840 DEBUG [RS:0;jenkins-hbase4:41603] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:23,840 INFO [RS:0;jenkins-hbase4:41603] regionserver.LeaseManager(133): Closed leases 2023-07-19 13:13:23,841 INFO [RS:0;jenkins-hbase4:41603] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 13:13:23,841 INFO [RS:0;jenkins-hbase4:41603] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 13:13:23,841 INFO [RS:0;jenkins-hbase4:41603] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 13:13:23,841 INFO [RS:0;jenkins-hbase4:41603] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 13:13:23,841 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 13:13:23,849 INFO [RS:0;jenkins-hbase4:41603] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41603 2023-07-19 13:13:23,864 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:13:23,864 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:13:23,864 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:13:23,864 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:13:23,864 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41603,1689772232926 2023-07-19 13:13:23,865 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:13:23,865 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:13:23,865 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41603,1689772232926] 2023-07-19 13:13:23,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877/.tmp/l/6c7866d49f4a43f3a48681c9767a530f 2023-07-19 13:13:23,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11/.tmp/info/0bd4f1233229449d9f18ef426d978e43 2023-07-19 13:13:23,872 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41603,1689772232926; numProcessing=1 2023-07-19 13:13:23,873 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/.tmp/info/ea8f14c7cf534e999844b34c14e74a73 2023-07-19 13:13:23,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c7866d49f4a43f3a48681c9767a530f 2023-07-19 13:13:23,874 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41603,1689772232926 already deleted, retry=false 2023-07-19 13:13:23,874 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41603,1689772232926 expired; onlineServers=2 2023-07-19 13:13:23,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11/.tmp/info/0bd4f1233229449d9f18ef426d978e43 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11/info/0bd4f1233229449d9f18ef426d978e43 2023-07-19 13:13:23,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877/.tmp/l/6c7866d49f4a43f3a48681c9767a530f as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877/l/6c7866d49f4a43f3a48681c9767a530f 2023-07-19 13:13:23,879 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea8f14c7cf534e999844b34c14e74a73 2023-07-19 13:13:23,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c7866d49f4a43f3a48681c9767a530f 2023-07-19 13:13:23,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877/l/6c7866d49f4a43f3a48681c9767a530f, entries=7, sequenceid=18, filesize=5.2 K 2023-07-19 13:13:23,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for b5b7aa3312a3928563d14ec9b4ef3877 in 70ms, sequenceid=18, compaction requested=false 2023-07-19 13:13:23,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11/info/0bd4f1233229449d9f18ef426d978e43, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 13:13:23,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8c0c372c89d9dea857cad4b5ddd06c11 in 68ms, sequenceid=6, compaction requested=false 2023-07-19 13:13:23,894 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 13:13:23,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/acl/b5b7aa3312a3928563d14ec9b4ef3877/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-19 13:13:23,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/namespace/8c0c372c89d9dea857cad4b5ddd06c11/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:13:23,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:23,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:23,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. 2023-07-19 13:13:23,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. 2023-07-19 13:13:23,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5b7aa3312a3928563d14ec9b4ef3877: 2023-07-19 13:13:23,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8c0c372c89d9dea857cad4b5ddd06c11: 2023-07-19 13:13:23,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689772236066.8c0c372c89d9dea857cad4b5ddd06c11. 2023-07-19 13:13:23,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689772236909.b5b7aa3312a3928563d14ec9b4ef3877. 2023-07-19 13:13:23,899 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/.tmp/rep_barrier/e61b710fffcb4a4aacc7b9382bbe2310 2023-07-19 13:13:23,903 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e61b710fffcb4a4aacc7b9382bbe2310 2023-07-19 13:13:23,905 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 13:13:23,917 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/.tmp/table/c33a3d55919b4c5291ec5cc11c56b8b5 2023-07-19 13:13:23,921 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c33a3d55919b4c5291ec5cc11c56b8b5 2023-07-19 13:13:23,922 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/.tmp/info/ea8f14c7cf534e999844b34c14e74a73 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/info/ea8f14c7cf534e999844b34c14e74a73 2023-07-19 13:13:23,927 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea8f14c7cf534e999844b34c14e74a73 2023-07-19 13:13:23,927 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/info/ea8f14c7cf534e999844b34c14e74a73, entries=48, sequenceid=131, filesize=10.3 K 2023-07-19 13:13:23,928 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/.tmp/rep_barrier/e61b710fffcb4a4aacc7b9382bbe2310 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/rep_barrier/e61b710fffcb4a4aacc7b9382bbe2310 2023-07-19 13:13:23,932 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e61b710fffcb4a4aacc7b9382bbe2310 2023-07-19 13:13:23,932 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/rep_barrier/e61b710fffcb4a4aacc7b9382bbe2310, entries=13, sequenceid=131, filesize=6.4 K 2023-07-19 13:13:23,933 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/.tmp/table/c33a3d55919b4c5291ec5cc11c56b8b5 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/table/c33a3d55919b4c5291ec5cc11c56b8b5 2023-07-19 13:13:23,936 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c33a3d55919b4c5291ec5cc11c56b8b5 2023-07-19 13:13:23,937 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/table/c33a3d55919b4c5291ec5cc11c56b8b5, entries=24, sequenceid=131, filesize=6.9 K 2023-07-19 13:13:23,937 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 117ms, sequenceid=131, compaction requested=false 2023-07-19 13:13:23,954 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-19 13:13:23,954 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:23,954 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 13:13:23,955 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 13:13:23,955 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 13:13:23,955 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 13:13:23,973 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:23,973 INFO [RS:0;jenkins-hbase4:41603] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41603,1689772232926; zookeeper connection closed. 2023-07-19 13:13:23,973 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:41603-0x1017db48a130001, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:23,974 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@25626d66] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@25626d66 2023-07-19 13:13:24,019 INFO [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40427,1689772233020; all regions closed. 2023-07-19 13:13:24,020 INFO [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40947,1689772233100; all regions closed. 2023-07-19 13:13:24,027 DEBUG [RS:1;jenkins-hbase4:40427] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/oldWALs 2023-07-19 13:13:24,027 DEBUG [RS:2;jenkins-hbase4:40947] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/oldWALs 2023-07-19 13:13:24,027 INFO [RS:2;jenkins-hbase4:40947] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40947%2C1689772233100:(num 1689772235274) 2023-07-19 13:13:24,027 DEBUG [RS:2;jenkins-hbase4:40947] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:24,027 INFO [RS:1;jenkins-hbase4:40427] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40427%2C1689772233020.meta:.meta(num 1689772235661) 2023-07-19 13:13:24,027 INFO [RS:2;jenkins-hbase4:40947] regionserver.LeaseManager(133): Closed leases 2023-07-19 13:13:24,027 INFO [RS:2;jenkins-hbase4:40947] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 13:13:24,028 INFO [RS:2;jenkins-hbase4:40947] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 13:13:24,028 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 13:13:24,028 INFO [RS:2;jenkins-hbase4:40947] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 13:13:24,028 INFO [RS:2;jenkins-hbase4:40947] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 13:13:24,029 INFO [RS:2;jenkins-hbase4:40947] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40947 2023-07-19 13:13:24,030 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:13:24,030 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:13:24,031 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40947,1689772233100 2023-07-19 13:13:24,032 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40947,1689772233100] 2023-07-19 13:13:24,032 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40947,1689772233100; numProcessing=2 2023-07-19 13:13:24,034 DEBUG [RS:1;jenkins-hbase4:40427] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/oldWALs 2023-07-19 13:13:24,034 INFO [RS:1;jenkins-hbase4:40427] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40427%2C1689772233020:(num 1689772235309) 2023-07-19 13:13:24,034 DEBUG [RS:1;jenkins-hbase4:40427] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:24,034 INFO [RS:1;jenkins-hbase4:40427] regionserver.LeaseManager(133): Closed leases 2023-07-19 13:13:24,034 INFO [RS:1;jenkins-hbase4:40427] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 13:13:24,034 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 13:13:24,035 INFO [RS:1;jenkins-hbase4:40427] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40427 2023-07-19 13:13:24,035 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40947,1689772233100 already deleted, retry=false 2023-07-19 13:13:24,035 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40947,1689772233100 expired; onlineServers=1 2023-07-19 13:13:24,036 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:13:24,036 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40427,1689772233020 2023-07-19 13:13:24,038 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40427,1689772233020] 2023-07-19 13:13:24,038 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40427,1689772233020; numProcessing=3 2023-07-19 13:13:24,040 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40427,1689772233020 already deleted, retry=false 2023-07-19 13:13:24,040 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40427,1689772233020 expired; onlineServers=0 2023-07-19 13:13:24,040 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33091,1689772231406' ***** 2023-07-19 13:13:24,040 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 13:13:24,040 DEBUG [M:0;jenkins-hbase4:33091] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66234e8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 13:13:24,040 INFO [M:0;jenkins-hbase4:33091] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33091,1689772231406 2023-07-19 13:13:24,040 INFO [M:0;jenkins-hbase4:33091] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33091,1689772231406; all regions closed. 2023-07-19 13:13:24,040 DEBUG [M:0;jenkins-hbase4:33091] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:24,040 DEBUG [M:0;jenkins-hbase4:33091] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 13:13:24,040 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 13:13:24,040 DEBUG [M:0;jenkins-hbase4:33091] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 13:13:24,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689772234755] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689772234755,5,FailOnTimeoutGroup] 2023-07-19 13:13:24,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689772234742] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689772234742,5,FailOnTimeoutGroup] 2023-07-19 13:13:24,040 INFO [M:0;jenkins-hbase4:33091] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 13:13:24,041 INFO [M:0;jenkins-hbase4:33091] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 13:13:24,041 INFO [M:0;jenkins-hbase4:33091] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-19 13:13:24,041 DEBUG [M:0;jenkins-hbase4:33091] master.HMaster(1512): Stopping service threads 2023-07-19 13:13:24,041 INFO [M:0;jenkins-hbase4:33091] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 13:13:24,041 ERROR [M:0;jenkins-hbase4:33091] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-07-19 13:13:24,041 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-19 13:13:24,041 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:13:24,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 13:13:24,042 INFO [M:0;jenkins-hbase4:33091] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 13:13:24,042 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 13:13:24,042 DEBUG [M:0;jenkins-hbase4:33091] zookeeper.ZKUtil(398): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 13:13:24,043 WARN [M:0;jenkins-hbase4:33091] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 13:13:24,043 INFO [M:0;jenkins-hbase4:33091] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 13:13:24,043 INFO [M:0;jenkins-hbase4:33091] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 13:13:24,043 DEBUG [M:0;jenkins-hbase4:33091] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 13:13:24,043 INFO [M:0;jenkins-hbase4:33091] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:13:24,043 DEBUG [M:0;jenkins-hbase4:33091] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:13:24,043 DEBUG [M:0;jenkins-hbase4:33091] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 13:13:24,043 DEBUG [M:0;jenkins-hbase4:33091] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:13:24,044 INFO [M:0;jenkins-hbase4:33091] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.64 KB heapSize=451.89 KB 2023-07-19 13:13:24,058 INFO [M:0;jenkins-hbase4:33091] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.64 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0290e27fcd6d4247b7cd5bcb0b81f260 2023-07-19 13:13:24,062 INFO [M:0;jenkins-hbase4:33091] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0290e27fcd6d4247b7cd5bcb0b81f260 2023-07-19 13:13:24,063 DEBUG [M:0;jenkins-hbase4:33091] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0290e27fcd6d4247b7cd5bcb0b81f260 as hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0290e27fcd6d4247b7cd5bcb0b81f260 2023-07-19 13:13:24,066 INFO [M:0;jenkins-hbase4:33091] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0290e27fcd6d4247b7cd5bcb0b81f260 2023-07-19 13:13:24,066 INFO [M:0;jenkins-hbase4:33091] regionserver.HStore(1080): Added hdfs://localhost:42143/user/jenkins/test-data/981e42bf-45bc-4c64-b3d0-5e3757139ca5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0290e27fcd6d4247b7cd5bcb0b81f260, entries=119, sequenceid=899, filesize=28.6 K 2023-07-19 13:13:24,067 INFO [M:0;jenkins-hbase4:33091] regionserver.HRegion(2948): Finished flush of dataSize ~375.64 KB/384651, heapSize ~451.88 KB/462720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-07-19 13:13:24,068 INFO [M:0;jenkins-hbase4:33091] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:13:24,068 DEBUG [M:0;jenkins-hbase4:33091] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 13:13:24,072 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 13:13:24,072 INFO [M:0;jenkins-hbase4:33091] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 13:13:24,072 INFO [M:0;jenkins-hbase4:33091] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33091 2023-07-19 13:13:24,074 DEBUG [M:0;jenkins-hbase4:33091] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33091,1689772231406 already deleted, retry=false 2023-07-19 13:13:24,134 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:24,134 INFO [RS:2;jenkins-hbase4:40947] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40947,1689772233100; zookeeper connection closed. 2023-07-19 13:13:24,134 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40947-0x1017db48a130003, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:24,134 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@44fea913] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@44fea913 2023-07-19 13:13:24,234 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:24,234 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): master:33091-0x1017db48a130000, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:24,234 INFO [M:0;jenkins-hbase4:33091] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33091,1689772231406; zookeeper connection closed. 2023-07-19 13:13:24,335 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:24,335 DEBUG [Listener at localhost/34287-EventThread] zookeeper.ZKWatcher(600): regionserver:40427-0x1017db48a130002, quorum=127.0.0.1:64840, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:24,335 INFO [RS:1;jenkins-hbase4:40427] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40427,1689772233020; zookeeper connection closed. 2023-07-19 13:13:24,335 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@799caebf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@799caebf 2023-07-19 13:13:24,335 INFO [Listener at jenkins-hbase4.apache.org/36809] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-19 13:13:24,336 WARN [Listener at jenkins-hbase4.apache.org/36809] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 13:13:24,349 INFO [Listener at jenkins-hbase4.apache.org/36809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 13:13:24,453 WARN [BP-1021718614-172.31.14.131-1689772226788 heartbeating to localhost/127.0.0.1:42143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 13:13:24,453 WARN [BP-1021718614-172.31.14.131-1689772226788 heartbeating to localhost/127.0.0.1:42143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1021718614-172.31.14.131-1689772226788 (Datanode Uuid b732f0fc-5c99-4f95-90f3-186785e06ab8) service to localhost/127.0.0.1:42143 2023-07-19 13:13:24,456 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/dfs/data/data5/current/BP-1021718614-172.31.14.131-1689772226788] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 13:13:24,456 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/dfs/data/data6/current/BP-1021718614-172.31.14.131-1689772226788] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 13:13:24,458 WARN [Listener at jenkins-hbase4.apache.org/36809] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 13:13:24,461 INFO [Listener at jenkins-hbase4.apache.org/36809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 13:13:24,565 WARN [BP-1021718614-172.31.14.131-1689772226788 heartbeating to localhost/127.0.0.1:42143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 13:13:24,565 WARN [BP-1021718614-172.31.14.131-1689772226788 heartbeating to localhost/127.0.0.1:42143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1021718614-172.31.14.131-1689772226788 (Datanode Uuid 517078b5-1c6b-4abb-ae9e-9b31cff1524d) service to localhost/127.0.0.1:42143 2023-07-19 13:13:24,566 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/dfs/data/data3/current/BP-1021718614-172.31.14.131-1689772226788] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 13:13:24,566 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/dfs/data/data4/current/BP-1021718614-172.31.14.131-1689772226788] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 13:13:24,567 WARN [Listener at jenkins-hbase4.apache.org/36809] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 13:13:24,570 INFO [Listener at jenkins-hbase4.apache.org/36809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 13:13:24,575 WARN [BP-1021718614-172.31.14.131-1689772226788 heartbeating to localhost/127.0.0.1:42143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 13:13:24,575 WARN [BP-1021718614-172.31.14.131-1689772226788 heartbeating to localhost/127.0.0.1:42143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1021718614-172.31.14.131-1689772226788 (Datanode Uuid 390a1473-0946-477e-96bd-9ea4b13b6afb) service to localhost/127.0.0.1:42143 2023-07-19 13:13:24,576 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/dfs/data/data1/current/BP-1021718614-172.31.14.131-1689772226788] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 13:13:24,577 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/20d028b6-665c-84e3-fac4-edb9fa95451f/cluster_8010b0ca-36a7-bd23-64b8-5d0bbef27939/dfs/data/data2/current/BP-1021718614-172.31.14.131-1689772226788] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 13:13:24,603 INFO [Listener at jenkins-hbase4.apache.org/36809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 13:13:24,731 INFO [Listener at jenkins-hbase4.apache.org/36809] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 13:13:25,013 INFO [Listener at jenkins-hbase4.apache.org/36809] hbase.HBaseTestingUtility(1293): Minicluster is down