2023-09-23 15:02:02,725 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-23 15:02:02,933 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109 2023-09-23 15:02:02,933 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-23 15:02:02,934 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-23 15:02:02,973 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-23 15:02:03,246 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-23 15:02:03,247 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de, deleteOnExit=true 2023-09-23 15:02:03,247 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-23 15:02:03,247 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/test.cache.data in system properties and HBase conf 2023-09-23 15:02:03,248 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop.tmp.dir in system properties and HBase conf 2023-09-23 15:02:03,248 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop.log.dir in system properties and HBase conf 2023-09-23 15:02:03,248 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-23 15:02:03,249 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-23 15:02:03,249 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-23 15:02:03,585 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-23 15:02:03,590 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-23 15:02:03,590 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-23 15:02:03,591 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-23 15:02:03,591 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 15:02:03,591 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-23 15:02:03,592 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-23 15:02:03,592 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 15:02:03,592 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 15:02:03,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-23 15:02:03,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/nfs.dump.dir in system properties and HBase conf 2023-09-23 15:02:03,594 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/java.io.tmpdir in system properties and HBase conf 2023-09-23 15:02:03,594 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 15:02:03,594 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-23 15:02:03,595 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-23 15:02:04,120 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-23 15:02:04,125 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-23 15:02:04,444 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-23 15:02:04,627 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-23 15:02:04,641 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 15:02:04,683 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 15:02:04,719 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/java.io.tmpdir/Jetty_localhost_41863_hdfs____.g3xqta/webapp 2023-09-23 15:02:04,863 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41863 2023-09-23 15:02:04,874 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-23 15:02:04,875 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-23 15:02:05,394 WARN [Listener at localhost/35975] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 15:02:05,467 WARN [Listener at localhost/35975] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-23 15:02:05,489 WARN [Listener at localhost/35975] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 15:02:05,497 INFO [Listener at localhost/35975] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 15:02:05,542 INFO [Listener at localhost/35975] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/java.io.tmpdir/Jetty_localhost_35563_datanode____8h9drr/webapp 2023-09-23 15:02:05,666 INFO [Listener at localhost/35975] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35563 2023-09-23 15:02:06,149 WARN [Listener at localhost/46559] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 15:02:06,168 WARN [Listener at localhost/46559] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-23 15:02:06,173 WARN [Listener at localhost/46559] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 15:02:06,175 INFO [Listener at localhost/46559] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 15:02:06,185 INFO [Listener at localhost/46559] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/java.io.tmpdir/Jetty_localhost_38381_datanode____.2p8pte/webapp 2023-09-23 15:02:06,327 INFO [Listener at localhost/46559] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38381 2023-09-23 15:02:06,340 WARN [Listener at localhost/35635] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 15:02:06,371 WARN [Listener at localhost/35635] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-23 15:02:06,375 WARN [Listener at localhost/35635] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 15:02:06,377 INFO [Listener at localhost/35635] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 15:02:06,386 INFO [Listener at localhost/35635] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/java.io.tmpdir/Jetty_localhost_42953_datanode____m7v3k0/webapp 2023-09-23 15:02:06,515 INFO [Listener at localhost/35635] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42953 2023-09-23 15:02:06,532 WARN [Listener at localhost/35841] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 15:02:06,756 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdb4f4abfb4b793db: Processing first storage report for DS-dc6292b8-d8db-4a5d-aac5-4d004656d8bf from datanode 07bc4283-0ba3-4e68-9c7b-d8753d4bdd9a 2023-09-23 15:02:06,758 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdb4f4abfb4b793db: from storage DS-dc6292b8-d8db-4a5d-aac5-4d004656d8bf node DatanodeRegistration(127.0.0.1:40923, datanodeUuid=07bc4283-0ba3-4e68-9c7b-d8753d4bdd9a, infoPort=37941, infoSecurePort=0, ipcPort=35635, storageInfo=lv=-57;cid=testClusterID;nsid=764332291;c=1695481324212), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-23 15:02:06,758 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6793f86b4cded9ca: Processing first storage report for DS-b875ba61-2321-47dc-93f4-5be17e15aca4 from datanode caed5075-6d05-4fc6-88bc-f87c43fa75b7 2023-09-23 15:02:06,758 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6793f86b4cded9ca: from storage DS-b875ba61-2321-47dc-93f4-5be17e15aca4 node DatanodeRegistration(127.0.0.1:42441, datanodeUuid=caed5075-6d05-4fc6-88bc-f87c43fa75b7, infoPort=35891, infoSecurePort=0, ipcPort=35841, storageInfo=lv=-57;cid=testClusterID;nsid=764332291;c=1695481324212), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-23 15:02:06,758 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x873d9e6da6712747: Processing first storage report for DS-6f15a4e2-2487-4690-9915-78e65741e015 from datanode 86b8c583-c178-4390-9b3f-8ff4abacec3c 2023-09-23 15:02:06,758 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x873d9e6da6712747: from storage DS-6f15a4e2-2487-4690-9915-78e65741e015 node DatanodeRegistration(127.0.0.1:44121, datanodeUuid=86b8c583-c178-4390-9b3f-8ff4abacec3c, infoPort=44311, infoSecurePort=0, ipcPort=46559, storageInfo=lv=-57;cid=testClusterID;nsid=764332291;c=1695481324212), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 15:02:06,759 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdb4f4abfb4b793db: Processing first storage report for DS-5410c545-544a-4f19-8e62-920b7bb414e1 from datanode 07bc4283-0ba3-4e68-9c7b-d8753d4bdd9a 2023-09-23 15:02:06,759 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdb4f4abfb4b793db: from storage DS-5410c545-544a-4f19-8e62-920b7bb414e1 node DatanodeRegistration(127.0.0.1:40923, datanodeUuid=07bc4283-0ba3-4e68-9c7b-d8753d4bdd9a, infoPort=37941, infoSecurePort=0, ipcPort=35635, storageInfo=lv=-57;cid=testClusterID;nsid=764332291;c=1695481324212), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 15:02:06,759 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6793f86b4cded9ca: Processing first storage report for DS-ec1f2b96-97ff-4631-8ebd-6e7ce80d0870 from datanode caed5075-6d05-4fc6-88bc-f87c43fa75b7 2023-09-23 15:02:06,759 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6793f86b4cded9ca: from storage DS-ec1f2b96-97ff-4631-8ebd-6e7ce80d0870 node DatanodeRegistration(127.0.0.1:42441, datanodeUuid=caed5075-6d05-4fc6-88bc-f87c43fa75b7, infoPort=35891, infoSecurePort=0, ipcPort=35841, storageInfo=lv=-57;cid=testClusterID;nsid=764332291;c=1695481324212), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 15:02:06,759 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x873d9e6da6712747: Processing first storage report for DS-575cab4e-75a8-4f4b-8a3e-c88b19936abb from datanode 86b8c583-c178-4390-9b3f-8ff4abacec3c 2023-09-23 15:02:06,759 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x873d9e6da6712747: from storage DS-575cab4e-75a8-4f4b-8a3e-c88b19936abb node DatanodeRegistration(127.0.0.1:44121, datanodeUuid=86b8c583-c178-4390-9b3f-8ff4abacec3c, infoPort=44311, infoSecurePort=0, ipcPort=46559, storageInfo=lv=-57;cid=testClusterID;nsid=764332291;c=1695481324212), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 15:02:07,055 DEBUG [Listener at localhost/35841] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109 2023-09-23 15:02:07,178 INFO [Listener at localhost/35841] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/zookeeper_0, clientPort=55260, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-23 15:02:07,200 INFO [Listener at localhost/35841] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55260 2023-09-23 15:02:07,213 INFO [Listener at localhost/35841] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 15:02:07,216 INFO [Listener at localhost/35841] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 15:02:07,937 INFO [Listener at localhost/35841] util.FSUtils(471): Created version file at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 with version=8 2023-09-23 15:02:07,937 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/hbase-staging 2023-09-23 15:02:08,331 INFO [Listener at localhost/35841] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-23 15:02:08,830 INFO [Listener at localhost/35841] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-23 15:02:08,865 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 15:02:08,866 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 15:02:08,866 INFO [Listener at localhost/35841] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 15:02:08,866 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 15:02:08,866 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 15:02:09,014 INFO [Listener at localhost/35841] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 15:02:09,091 DEBUG [Listener at localhost/35841] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-23 15:02:09,186 INFO [Listener at localhost/35841] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40555 2023-09-23 15:02:09,202 INFO [Listener at localhost/35841] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 15:02:09,204 INFO [Listener at localhost/35841] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 15:02:09,227 INFO [Listener at localhost/35841] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40555 connecting to ZooKeeper ensemble=127.0.0.1:55260 2023-09-23 15:02:09,290 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:405550x0, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 15:02:09,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40555-0x100d94f25c80000 connected 2023-09-23 15:02:09,323 DEBUG [Listener at localhost/35841] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 15:02:09,324 DEBUG [Listener at localhost/35841] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 15:02:09,337 DEBUG [Listener at localhost/35841] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 15:02:09,345 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40555 2023-09-23 15:02:09,346 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40555 2023-09-23 15:02:09,346 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40555 2023-09-23 15:02:09,347 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40555 2023-09-23 15:02:09,347 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40555 2023-09-23 15:02:09,354 INFO [Listener at localhost/35841] master.HMaster(444): hbase.rootdir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8, hbase.cluster.distributed=false 2023-09-23 15:02:09,420 INFO [Listener at localhost/35841] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-23 15:02:09,421 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 15:02:09,421 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 15:02:09,421 INFO [Listener at localhost/35841] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 15:02:09,421 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 15:02:09,421 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 15:02:09,426 INFO [Listener at localhost/35841] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 15:02:09,429 INFO [Listener at localhost/35841] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40421 2023-09-23 15:02:09,432 INFO [Listener at localhost/35841] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-23 15:02:09,439 INFO [Listener at localhost/35841] mob.MobFileCache(124): MobFileCache disabled 2023-09-23 15:02:09,440 INFO [Listener at localhost/35841] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 15:02:09,442 INFO [Listener at localhost/35841] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 15:02:09,444 INFO [Listener at localhost/35841] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40421 connecting to ZooKeeper ensemble=127.0.0.1:55260 2023-09-23 15:02:09,448 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:404210x0, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 15:02:09,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40421-0x100d94f25c80001 connected 2023-09-23 15:02:09,450 DEBUG [Listener at localhost/35841] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 15:02:09,451 DEBUG [Listener at localhost/35841] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 15:02:09,452 DEBUG [Listener at localhost/35841] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 15:02:09,452 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40421 2023-09-23 15:02:09,453 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40421 2023-09-23 15:02:09,453 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40421 2023-09-23 15:02:09,453 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40421 2023-09-23 15:02:09,454 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40421 2023-09-23 15:02:09,466 INFO [Listener at localhost/35841] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-23 15:02:09,466 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 15:02:09,467 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 15:02:09,467 INFO [Listener at localhost/35841] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 15:02:09,467 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 15:02:09,467 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 15:02:09,468 INFO [Listener at localhost/35841] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 15:02:09,470 INFO [Listener at localhost/35841] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39755 2023-09-23 15:02:09,470 INFO [Listener at localhost/35841] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-23 15:02:09,472 INFO [Listener at localhost/35841] mob.MobFileCache(124): MobFileCache disabled 2023-09-23 15:02:09,473 INFO [Listener at localhost/35841] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 15:02:09,476 INFO [Listener at localhost/35841] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 15:02:09,479 INFO [Listener at localhost/35841] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39755 connecting to ZooKeeper ensemble=127.0.0.1:55260 2023-09-23 15:02:09,485 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:397550x0, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 15:02:09,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39755-0x100d94f25c80002 connected 2023-09-23 15:02:09,486 DEBUG [Listener at localhost/35841] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 15:02:09,487 DEBUG [Listener at localhost/35841] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 15:02:09,488 DEBUG [Listener at localhost/35841] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 15:02:09,489 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39755 2023-09-23 15:02:09,493 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39755 2023-09-23 15:02:09,493 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39755 2023-09-23 15:02:09,497 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39755 2023-09-23 15:02:09,497 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39755 2023-09-23 15:02:09,510 INFO [Listener at localhost/35841] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-23 15:02:09,510 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 15:02:09,510 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 15:02:09,510 INFO [Listener at localhost/35841] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 15:02:09,510 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 15:02:09,510 INFO [Listener at localhost/35841] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 15:02:09,510 INFO [Listener at localhost/35841] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 15:02:09,512 INFO [Listener at localhost/35841] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39421 2023-09-23 15:02:09,512 INFO [Listener at localhost/35841] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-23 15:02:09,513 INFO [Listener at localhost/35841] mob.MobFileCache(124): MobFileCache disabled 2023-09-23 15:02:09,514 INFO [Listener at localhost/35841] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 15:02:09,516 INFO [Listener at localhost/35841] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 15:02:09,518 INFO [Listener at localhost/35841] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39421 connecting to ZooKeeper ensemble=127.0.0.1:55260 2023-09-23 15:02:09,521 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:394210x0, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 15:02:09,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39421-0x100d94f25c80003 connected 2023-09-23 15:02:09,522 DEBUG [Listener at localhost/35841] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 15:02:09,523 DEBUG [Listener at localhost/35841] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 15:02:09,524 DEBUG [Listener at localhost/35841] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 15:02:09,525 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39421 2023-09-23 15:02:09,526 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39421 2023-09-23 15:02:09,527 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39421 2023-09-23 15:02:09,529 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39421 2023-09-23 15:02:09,531 DEBUG [Listener at localhost/35841] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39421 2023-09-23 15:02:09,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40555,1695481328153 2023-09-23 15:02:09,542 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-23 15:02:09,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40555,1695481328153 2023-09-23 15:02:09,564 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 15:02:09,564 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 15:02:09,564 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 15:02:09,564 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 15:02:09,564 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 15:02:09,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-23 15:02:09,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40555,1695481328153 from backup master directory 2023-09-23 15:02:09,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-23 15:02:09,574 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40555,1695481328153 2023-09-23 15:02:09,574 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-23 15:02:09,575 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 15:02:09,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40555,1695481328153 2023-09-23 15:02:09,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-23 15:02:09,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-23 15:02:09,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/hbase.id with ID: 1161170b-dabf-486c-b67c-6d0b0f5133aa 2023-09-23 15:02:09,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 15:02:09,748 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 15:02:09,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x55411c59 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:09,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@178170ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:09,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-23 15:02:09,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-23 15:02:09,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-23 15:02:09,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-23 15:02:09,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-23 15:02:09,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-23 15:02:09,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 15:02:09,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/data/master/store-tmp 2023-09-23 15:02:09,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:09,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-23 15:02:09,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 15:02:09,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 15:02:09,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-23 15:02:09,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 15:02:09,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 15:02:09,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-23 15:02:09,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/WALs/jenkins-hbase4.apache.org,40555,1695481328153 2023-09-23 15:02:10,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40555%2C1695481328153, suffix=, logDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/WALs/jenkins-hbase4.apache.org,40555,1695481328153, archiveDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/oldWALs, maxLogs=10 2023-09-23 15:02:10,084 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40923,DS-dc6292b8-d8db-4a5d-aac5-4d004656d8bf,DISK] 2023-09-23 15:02:10,084 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42441,DS-b875ba61-2321-47dc-93f4-5be17e15aca4,DISK] 2023-09-23 15:02:10,084 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44121,DS-6f15a4e2-2487-4690-9915-78e65741e015,DISK] 2023-09-23 15:02:10,094 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-23 15:02:10,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/WALs/jenkins-hbase4.apache.org,40555,1695481328153/jenkins-hbase4.apache.org%2C40555%2C1695481328153.1695481330017 2023-09-23 15:02:10,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44121,DS-6f15a4e2-2487-4690-9915-78e65741e015,DISK], DatanodeInfoWithStorage[127.0.0.1:42441,DS-b875ba61-2321-47dc-93f4-5be17e15aca4,DISK], DatanodeInfoWithStorage[127.0.0.1:40923,DS-dc6292b8-d8db-4a5d-aac5-4d004656d8bf,DISK]] 2023-09-23 15:02:10,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-23 15:02:10,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:10,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-23 15:02:10,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-23 15:02:10,264 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-23 15:02:10,271 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-23 15:02:10,300 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-23 15:02:10,313 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:10,319 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-23 15:02:10,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-23 15:02:10,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-23 15:02:10,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:02:10,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74408369, jitterRate=0.10877110064029694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:02:10,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-23 15:02:10,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-23 15:02:10,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-23 15:02:10,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-23 15:02:10,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-23 15:02:10,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-23 15:02:10,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-23 15:02:10,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-23 15:02:10,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-23 15:02:10,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-23 15:02:10,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-23 15:02:10,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-23 15:02:10,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-23 15:02:10,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-23 15:02:10,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-23 15:02:10,497 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 15:02:10,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-23 15:02:10,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-23 15:02:10,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-23 15:02:10,522 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 15:02:10,522 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 15:02:10,522 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 15:02:10,522 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 15:02:10,522 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 15:02:10,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40555,1695481328153, sessionid=0x100d94f25c80000, setting cluster-up flag (Was=false) 2023-09-23 15:02:10,546 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 15:02:10,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-23 15:02:10,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40555,1695481328153 2023-09-23 15:02:10,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 15:02:10,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-23 15:02:10,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40555,1695481328153 2023-09-23 15:02:10,574 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp 2023-09-23 15:02:10,637 INFO [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(951): ClusterId : 1161170b-dabf-486c-b67c-6d0b0f5133aa 2023-09-23 15:02:10,637 INFO [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(951): ClusterId : 1161170b-dabf-486c-b67c-6d0b0f5133aa 2023-09-23 15:02:10,637 INFO [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(951): ClusterId : 1161170b-dabf-486c-b67c-6d0b0f5133aa 2023-09-23 15:02:10,644 DEBUG [RS:0;jenkins-hbase4:40421] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-23 15:02:10,644 DEBUG [RS:1;jenkins-hbase4:39755] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-23 15:02:10,644 DEBUG [RS:2;jenkins-hbase4:39421] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-23 15:02:10,652 DEBUG [RS:1;jenkins-hbase4:39755] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-23 15:02:10,652 DEBUG [RS:2;jenkins-hbase4:39421] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-23 15:02:10,652 DEBUG [RS:0;jenkins-hbase4:40421] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-23 15:02:10,653 DEBUG [RS:2;jenkins-hbase4:39421] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-23 15:02:10,652 DEBUG [RS:1;jenkins-hbase4:39755] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-23 15:02:10,653 DEBUG [RS:0;jenkins-hbase4:40421] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-23 15:02:10,657 DEBUG [RS:1;jenkins-hbase4:39755] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-23 15:02:10,660 DEBUG [RS:0;jenkins-hbase4:40421] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-23 15:02:10,661 DEBUG [RS:2;jenkins-hbase4:39421] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-23 15:02:10,663 DEBUG [RS:1;jenkins-hbase4:39755] zookeeper.ReadOnlyZKClient(139): Connect 0x3cbc7047 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:10,664 DEBUG [RS:2;jenkins-hbase4:39421] zookeeper.ReadOnlyZKClient(139): Connect 0x43be4382 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:10,664 DEBUG [RS:0;jenkins-hbase4:40421] zookeeper.ReadOnlyZKClient(139): Connect 0x7ddad224 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:10,680 DEBUG [RS:1;jenkins-hbase4:39755] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@327b99a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:10,680 DEBUG [RS:2;jenkins-hbase4:39421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d79a585, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:10,681 DEBUG [RS:1;jenkins-hbase4:39755] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36441b37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-23 15:02:10,681 DEBUG [RS:2;jenkins-hbase4:39421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@494628f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-23 15:02:10,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-23 15:02:10,714 DEBUG [RS:0;jenkins-hbase4:40421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@731d33ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:10,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:10,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-23 15:02:10,715 DEBUG [RS:0;jenkins-hbase4:40421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@322039d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-23 15:02:10,732 DEBUG [RS:1;jenkins-hbase4:39755] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39755 2023-09-23 15:02:10,736 DEBUG [RS:2;jenkins-hbase4:39421] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:39421 2023-09-23 15:02:10,737 DEBUG [RS:0;jenkins-hbase4:40421] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40421 2023-09-23 15:02:10,738 INFO [RS:1;jenkins-hbase4:39755] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-23 15:02:10,738 INFO [RS:0;jenkins-hbase4:40421] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-23 15:02:10,738 INFO [RS:1;jenkins-hbase4:39755] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-23 15:02:10,738 INFO [RS:2;jenkins-hbase4:39421] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-23 15:02:10,738 INFO [RS:0;jenkins-hbase4:40421] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-23 15:02:10,739 INFO [RS:2;jenkins-hbase4:39421] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-23 15:02:10,739 DEBUG [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-23 15:02:10,739 DEBUG [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-23 15:02:10,739 DEBUG [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-23 15:02:10,740 INFO [RS:1;jenkins-hbase4:39755] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:10,740 INFO [RS:2;jenkins-hbase4:39421] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:10,740 DEBUG [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1022): About to register with Master. 2023-09-23 15:02:10,740 INFO [RS:0;jenkins-hbase4:40421] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:10,740 DEBUG [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1022): About to register with Master. 2023-09-23 15:02:10,740 DEBUG [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(1022): About to register with Master. 2023-09-23 15:02:10,744 INFO [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40555,1695481328153 with isa=jenkins-hbase4.apache.org/172.31.14.131:39755, startcode=1695481329466 2023-09-23 15:02:10,744 INFO [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40555,1695481328153 with isa=jenkins-hbase4.apache.org/172.31.14.131:40421, startcode=1695481329420 2023-09-23 15:02:10,744 INFO [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40555,1695481328153 with isa=jenkins-hbase4.apache.org/172.31.14.131:39421, startcode=1695481329509 2023-09-23 15:02:10,763 DEBUG [RS:2;jenkins-hbase4:39421] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-23 15:02:10,763 DEBUG [RS:0;jenkins-hbase4:40421] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-23 15:02:10,763 DEBUG [RS:1;jenkins-hbase4:39755] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-23 15:02:10,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-23 15:02:10,821 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36753, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-23 15:02:10,821 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40545, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-23 15:02:10,821 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36907, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-23 15:02:10,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-23 15:02:10,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-23 15:02:10,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-23 15:02:10,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-23 15:02:10,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-23 15:02:10,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:10,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-23 15:02:10,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:10,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695481360827 2023-09-23 15:02:10,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-23 15:02:10,832 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40555] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-23 15:02:10,836 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-23 15:02:10,837 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-23 15:02:10,841 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40555] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-23 15:02:10,842 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40555] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-23 15:02:10,845 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-23 15:02:10,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-23 15:02:10,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-23 15:02:10,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-23 15:02:10,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-23 15:02:10,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-23 15:02:10,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:10,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-23 15:02:10,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-23 15:02:10,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-23 15:02:10,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-23 15:02:10,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-23 15:02:10,869 DEBUG [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(2830): Master is not running yet 2023-09-23 15:02:10,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695481330866,5,FailOnTimeoutGroup] 2023-09-23 15:02:10,869 DEBUG [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(2830): Master is not running yet 2023-09-23 15:02:10,869 DEBUG [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(2830): Master is not running yet 2023-09-23 15:02:10,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695481330870,5,FailOnTimeoutGroup] 2023-09-23 15:02:10,870 WARN [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-23 15:02:10,870 WARN [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-23 15:02:10,870 WARN [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-23 15:02:10,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:10,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-23 15:02:10,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:10,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:10,887 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-23 15:02:10,888 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-23 15:02:10,889 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:02:10,911 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:10,914 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-23 15:02:10,916 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/info 2023-09-23 15:02:10,917 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-23 15:02:10,918 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:10,918 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-23 15:02:10,921 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/rep_barrier 2023-09-23 15:02:10,921 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-23 15:02:10,922 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:10,922 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-23 15:02:10,924 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/table 2023-09-23 15:02:10,925 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-23 15:02:10,926 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:10,927 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740 2023-09-23 15:02:10,929 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740 2023-09-23 15:02:10,932 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-23 15:02:10,935 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-23 15:02:10,939 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:02:10,940 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65205180, jitterRate=-0.02836710214614868}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-23 15:02:10,941 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-23 15:02:10,941 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-23 15:02:10,941 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-23 15:02:10,941 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-23 15:02:10,941 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-23 15:02:10,941 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-23 15:02:10,943 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-23 15:02:10,943 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-23 15:02:10,950 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-23 15:02:10,950 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-23 15:02:10,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-23 15:02:10,971 INFO [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40555,1695481328153 with isa=jenkins-hbase4.apache.org/172.31.14.131:40421, startcode=1695481329420 2023-09-23 15:02:10,971 INFO [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40555,1695481328153 with isa=jenkins-hbase4.apache.org/172.31.14.131:39755, startcode=1695481329466 2023-09-23 15:02:10,971 INFO [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40555,1695481328153 with isa=jenkins-hbase4.apache.org/172.31.14.131:39421, startcode=1695481329509 2023-09-23 15:02:10,977 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40555] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:10,982 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-23 15:02:10,984 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40555] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:10,985 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40555] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:10,985 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-23 15:02:10,986 DEBUG [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:02:10,986 DEBUG [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35975 2023-09-23 15:02:10,986 DEBUG [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-23 15:02:10,987 DEBUG [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:02:10,987 DEBUG [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:02:10,987 DEBUG [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35975 2023-09-23 15:02:10,987 DEBUG [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35975 2023-09-23 15:02:10,987 DEBUG [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-23 15:02:10,988 DEBUG [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-23 15:02:10,996 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 15:02:10,998 DEBUG [RS:0;jenkins-hbase4:40421] zookeeper.ZKUtil(162): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:10,998 DEBUG [RS:2;jenkins-hbase4:39421] zookeeper.ZKUtil(162): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:10,998 WARN [RS:0;jenkins-hbase4:40421] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 15:02:10,998 WARN [RS:2;jenkins-hbase4:39421] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 15:02:10,999 INFO [RS:0;jenkins-hbase4:40421] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 15:02:10,999 INFO [RS:2;jenkins-hbase4:39421] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 15:02:10,999 DEBUG [RS:1;jenkins-hbase4:39755] zookeeper.ZKUtil(162): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:10,999 DEBUG [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/WALs/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:10,999 WARN [RS:1;jenkins-hbase4:39755] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 15:02:10,999 DEBUG [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/WALs/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:11,000 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39421,1695481329509] 2023-09-23 15:02:11,000 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39755,1695481329466] 2023-09-23 15:02:11,000 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40421,1695481329420] 2023-09-23 15:02:11,000 INFO [RS:1;jenkins-hbase4:39755] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 15:02:11,000 DEBUG [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/WALs/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:11,012 DEBUG [RS:1;jenkins-hbase4:39755] zookeeper.ZKUtil(162): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:11,012 DEBUG [RS:2;jenkins-hbase4:39421] zookeeper.ZKUtil(162): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:11,012 DEBUG [RS:0;jenkins-hbase4:40421] zookeeper.ZKUtil(162): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:11,013 DEBUG [RS:1;jenkins-hbase4:39755] zookeeper.ZKUtil(162): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:11,013 DEBUG [RS:2;jenkins-hbase4:39421] zookeeper.ZKUtil(162): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:11,013 DEBUG [RS:0;jenkins-hbase4:40421] zookeeper.ZKUtil(162): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:11,013 DEBUG [RS:1;jenkins-hbase4:39755] zookeeper.ZKUtil(162): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:11,014 DEBUG [RS:2;jenkins-hbase4:39421] zookeeper.ZKUtil(162): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:11,014 DEBUG [RS:0;jenkins-hbase4:40421] zookeeper.ZKUtil(162): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:11,026 DEBUG [RS:2;jenkins-hbase4:39421] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-23 15:02:11,026 DEBUG [RS:1;jenkins-hbase4:39755] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-23 15:02:11,026 DEBUG [RS:0;jenkins-hbase4:40421] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-23 15:02:11,037 INFO [RS:0;jenkins-hbase4:40421] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-23 15:02:11,037 INFO [RS:1;jenkins-hbase4:39755] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-23 15:02:11,037 INFO [RS:2;jenkins-hbase4:39421] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-23 15:02:11,061 INFO [RS:0;jenkins-hbase4:40421] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-23 15:02:11,061 INFO [RS:2;jenkins-hbase4:39421] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-23 15:02:11,061 INFO [RS:1;jenkins-hbase4:39755] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-23 15:02:11,066 INFO [RS:0;jenkins-hbase4:40421] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-23 15:02:11,066 INFO [RS:2;jenkins-hbase4:39421] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-23 15:02:11,066 INFO [RS:0;jenkins-hbase4:40421] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,066 INFO [RS:1;jenkins-hbase4:39755] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-23 15:02:11,067 INFO [RS:2;jenkins-hbase4:39421] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,067 INFO [RS:1;jenkins-hbase4:39755] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,068 INFO [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-23 15:02:11,068 INFO [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-23 15:02:11,068 INFO [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-23 15:02:11,077 INFO [RS:1;jenkins-hbase4:39755] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,077 INFO [RS:0;jenkins-hbase4:40421] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,077 INFO [RS:2;jenkins-hbase4:39421] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,078 DEBUG [RS:1;jenkins-hbase4:39755] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,078 DEBUG [RS:0;jenkins-hbase4:40421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,078 DEBUG [RS:2;jenkins-hbase4:39421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,078 DEBUG [RS:0;jenkins-hbase4:40421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,078 DEBUG [RS:2;jenkins-hbase4:39421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,078 DEBUG [RS:0;jenkins-hbase4:40421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,078 DEBUG [RS:2;jenkins-hbase4:39421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,078 DEBUG [RS:0;jenkins-hbase4:40421] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,079 DEBUG [RS:2;jenkins-hbase4:39421] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,079 DEBUG [RS:0;jenkins-hbase4:40421] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,079 DEBUG [RS:2;jenkins-hbase4:39421] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,079 DEBUG [RS:0;jenkins-hbase4:40421] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-23 15:02:11,079 DEBUG [RS:2;jenkins-hbase4:39421] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-23 15:02:11,079 DEBUG [RS:0;jenkins-hbase4:40421] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,079 DEBUG [RS:2;jenkins-hbase4:39421] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,078 DEBUG [RS:1;jenkins-hbase4:39755] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,079 DEBUG [RS:2;jenkins-hbase4:39421] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,079 DEBUG [RS:0;jenkins-hbase4:40421] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,079 DEBUG [RS:2;jenkins-hbase4:39421] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,079 DEBUG [RS:0;jenkins-hbase4:40421] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,079 DEBUG [RS:2;jenkins-hbase4:39421] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,079 DEBUG [RS:0;jenkins-hbase4:40421] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,079 DEBUG [RS:1;jenkins-hbase4:39755] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,080 DEBUG [RS:1;jenkins-hbase4:39755] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,080 DEBUG [RS:1;jenkins-hbase4:39755] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,081 DEBUG [RS:1;jenkins-hbase4:39755] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-23 15:02:11,081 DEBUG [RS:1;jenkins-hbase4:39755] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,081 DEBUG [RS:1;jenkins-hbase4:39755] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,081 DEBUG [RS:1;jenkins-hbase4:39755] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,081 DEBUG [RS:1;jenkins-hbase4:39755] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 15:02:11,082 INFO [RS:2;jenkins-hbase4:39421] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,082 INFO [RS:0;jenkins-hbase4:40421] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,082 INFO [RS:2;jenkins-hbase4:39421] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,082 INFO [RS:0;jenkins-hbase4:40421] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,082 INFO [RS:2;jenkins-hbase4:39421] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,082 INFO [RS:0;jenkins-hbase4:40421] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,085 INFO [RS:1;jenkins-hbase4:39755] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,085 INFO [RS:1;jenkins-hbase4:39755] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,085 INFO [RS:1;jenkins-hbase4:39755] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,103 INFO [RS:2;jenkins-hbase4:39421] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-23 15:02:11,103 INFO [RS:1;jenkins-hbase4:39755] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-23 15:02:11,103 INFO [RS:0;jenkins-hbase4:40421] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-23 15:02:11,107 INFO [RS:2;jenkins-hbase4:39421] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39421,1695481329509-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,107 INFO [RS:1;jenkins-hbase4:39755] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39755,1695481329466-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,107 INFO [RS:0;jenkins-hbase4:40421] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40421,1695481329420-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,130 INFO [RS:2;jenkins-hbase4:39421] regionserver.Replication(203): jenkins-hbase4.apache.org,39421,1695481329509 started 2023-09-23 15:02:11,130 INFO [RS:1;jenkins-hbase4:39755] regionserver.Replication(203): jenkins-hbase4.apache.org,39755,1695481329466 started 2023-09-23 15:02:11,130 INFO [RS:0;jenkins-hbase4:40421] regionserver.Replication(203): jenkins-hbase4.apache.org,40421,1695481329420 started 2023-09-23 15:02:11,130 INFO [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39421,1695481329509, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39421, sessionid=0x100d94f25c80003 2023-09-23 15:02:11,131 INFO [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40421,1695481329420, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40421, sessionid=0x100d94f25c80001 2023-09-23 15:02:11,131 INFO [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39755,1695481329466, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39755, sessionid=0x100d94f25c80002 2023-09-23 15:02:11,131 DEBUG [RS:0;jenkins-hbase4:40421] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-23 15:02:11,131 DEBUG [RS:1;jenkins-hbase4:39755] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-23 15:02:11,131 DEBUG [RS:2;jenkins-hbase4:39421] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-23 15:02:11,131 DEBUG [RS:1;jenkins-hbase4:39755] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:11,131 DEBUG [RS:0;jenkins-hbase4:40421] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:11,132 DEBUG [RS:1;jenkins-hbase4:39755] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39755,1695481329466' 2023-09-23 15:02:11,132 DEBUG [RS:2;jenkins-hbase4:39421] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:11,133 DEBUG [RS:1;jenkins-hbase4:39755] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-23 15:02:11,132 DEBUG [RS:0;jenkins-hbase4:40421] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40421,1695481329420' 2023-09-23 15:02:11,133 DEBUG [RS:0;jenkins-hbase4:40421] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-23 15:02:11,133 DEBUG [RS:2;jenkins-hbase4:39421] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39421,1695481329509' 2023-09-23 15:02:11,134 DEBUG [RS:2;jenkins-hbase4:39421] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-23 15:02:11,134 DEBUG [RS:1;jenkins-hbase4:39755] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-23 15:02:11,134 DEBUG [RS:0;jenkins-hbase4:40421] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-23 15:02:11,134 DEBUG [RS:2;jenkins-hbase4:39421] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-23 15:02:11,135 DEBUG [RS:0;jenkins-hbase4:40421] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-23 15:02:11,135 DEBUG [RS:2;jenkins-hbase4:39421] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-23 15:02:11,135 DEBUG [RS:0;jenkins-hbase4:40421] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-23 15:02:11,135 DEBUG [RS:1;jenkins-hbase4:39755] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-23 15:02:11,135 DEBUG [RS:0;jenkins-hbase4:40421] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:11,135 DEBUG [RS:2;jenkins-hbase4:39421] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-23 15:02:11,135 DEBUG [RS:0;jenkins-hbase4:40421] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40421,1695481329420' 2023-09-23 15:02:11,137 DEBUG [RS:0;jenkins-hbase4:40421] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:11,135 DEBUG [RS:1;jenkins-hbase4:39755] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-23 15:02:11,135 DEBUG [RS:2;jenkins-hbase4:39421] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:11,137 DEBUG [RS:2;jenkins-hbase4:39421] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39421,1695481329509' 2023-09-23 15:02:11,137 DEBUG [RS:2;jenkins-hbase4:39421] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:11,137 DEBUG [RS:1;jenkins-hbase4:39755] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:11,137 DEBUG [RS:1;jenkins-hbase4:39755] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39755,1695481329466' 2023-09-23 15:02:11,137 DEBUG [RS:1;jenkins-hbase4:39755] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:11,137 DEBUG [RS:0;jenkins-hbase4:40421] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:11,138 DEBUG [RS:2;jenkins-hbase4:39421] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:11,138 DEBUG [RS:1;jenkins-hbase4:39755] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:11,139 DEBUG [jenkins-hbase4:40555] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-23 15:02:11,141 DEBUG [RS:0;jenkins-hbase4:40421] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-23 15:02:11,141 INFO [RS:0;jenkins-hbase4:40421] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-23 15:02:11,141 DEBUG [RS:1;jenkins-hbase4:39755] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-23 15:02:11,141 INFO [RS:0;jenkins-hbase4:40421] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-23 15:02:11,141 DEBUG [RS:2;jenkins-hbase4:39421] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-23 15:02:11,141 INFO [RS:1;jenkins-hbase4:39755] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-23 15:02:11,141 INFO [RS:2;jenkins-hbase4:39421] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-23 15:02:11,142 INFO [RS:2;jenkins-hbase4:39421] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-23 15:02:11,141 INFO [RS:1;jenkins-hbase4:39755] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-23 15:02:11,143 DEBUG [jenkins-hbase4:40555] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 15:02:11,149 DEBUG [jenkins-hbase4:40555] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 15:02:11,149 DEBUG [jenkins-hbase4:40555] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 15:02:11,149 DEBUG [jenkins-hbase4:40555] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 15:02:11,149 DEBUG [jenkins-hbase4:40555] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 15:02:11,152 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39755,1695481329466, state=OPENING 2023-09-23 15:02:11,161 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-23 15:02:11,163 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 15:02:11,163 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-23 15:02:11,167 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39755,1695481329466}] 2023-09-23 15:02:11,257 INFO [RS:0;jenkins-hbase4:40421] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40421%2C1695481329420, suffix=, logDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/WALs/jenkins-hbase4.apache.org,40421,1695481329420, archiveDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/oldWALs, maxLogs=32 2023-09-23 15:02:11,257 INFO [RS:1;jenkins-hbase4:39755] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39755%2C1695481329466, suffix=, logDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/WALs/jenkins-hbase4.apache.org,39755,1695481329466, archiveDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/oldWALs, maxLogs=32 2023-09-23 15:02:11,257 INFO [RS:2;jenkins-hbase4:39421] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39421%2C1695481329509, suffix=, logDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/WALs/jenkins-hbase4.apache.org,39421,1695481329509, archiveDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/oldWALs, maxLogs=32 2023-09-23 15:02:11,285 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42441,DS-b875ba61-2321-47dc-93f4-5be17e15aca4,DISK] 2023-09-23 15:02:11,285 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42441,DS-b875ba61-2321-47dc-93f4-5be17e15aca4,DISK] 2023-09-23 15:02:11,286 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44121,DS-6f15a4e2-2487-4690-9915-78e65741e015,DISK] 2023-09-23 15:02:11,286 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40923,DS-dc6292b8-d8db-4a5d-aac5-4d004656d8bf,DISK] 2023-09-23 15:02:11,286 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40923,DS-dc6292b8-d8db-4a5d-aac5-4d004656d8bf,DISK] 2023-09-23 15:02:11,292 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44121,DS-6f15a4e2-2487-4690-9915-78e65741e015,DISK] 2023-09-23 15:02:11,305 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44121,DS-6f15a4e2-2487-4690-9915-78e65741e015,DISK] 2023-09-23 15:02:11,309 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40923,DS-dc6292b8-d8db-4a5d-aac5-4d004656d8bf,DISK] 2023-09-23 15:02:11,309 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42441,DS-b875ba61-2321-47dc-93f4-5be17e15aca4,DISK] 2023-09-23 15:02:11,310 INFO [RS:0;jenkins-hbase4:40421] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/WALs/jenkins-hbase4.apache.org,40421,1695481329420/jenkins-hbase4.apache.org%2C40421%2C1695481329420.1695481331262 2023-09-23 15:02:11,310 INFO [RS:2;jenkins-hbase4:39421] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/WALs/jenkins-hbase4.apache.org,39421,1695481329509/jenkins-hbase4.apache.org%2C39421%2C1695481329509.1695481331262 2023-09-23 15:02:11,311 DEBUG [RS:0;jenkins-hbase4:40421] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42441,DS-b875ba61-2321-47dc-93f4-5be17e15aca4,DISK], DatanodeInfoWithStorage[127.0.0.1:40923,DS-dc6292b8-d8db-4a5d-aac5-4d004656d8bf,DISK], DatanodeInfoWithStorage[127.0.0.1:44121,DS-6f15a4e2-2487-4690-9915-78e65741e015,DISK]] 2023-09-23 15:02:11,311 DEBUG [RS:2;jenkins-hbase4:39421] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44121,DS-6f15a4e2-2487-4690-9915-78e65741e015,DISK], DatanodeInfoWithStorage[127.0.0.1:40923,DS-dc6292b8-d8db-4a5d-aac5-4d004656d8bf,DISK], DatanodeInfoWithStorage[127.0.0.1:42441,DS-b875ba61-2321-47dc-93f4-5be17e15aca4,DISK]] 2023-09-23 15:02:11,316 INFO [RS:1;jenkins-hbase4:39755] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/WALs/jenkins-hbase4.apache.org,39755,1695481329466/jenkins-hbase4.apache.org%2C39755%2C1695481329466.1695481331262 2023-09-23 15:02:11,317 DEBUG [RS:1;jenkins-hbase4:39755] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42441,DS-b875ba61-2321-47dc-93f4-5be17e15aca4,DISK], DatanodeInfoWithStorage[127.0.0.1:44121,DS-6f15a4e2-2487-4690-9915-78e65741e015,DISK], DatanodeInfoWithStorage[127.0.0.1:40923,DS-dc6292b8-d8db-4a5d-aac5-4d004656d8bf,DISK]] 2023-09-23 15:02:11,363 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:11,365 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 15:02:11,369 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 15:02:11,383 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-23 15:02:11,384 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 15:02:11,387 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39755%2C1695481329466.meta, suffix=.meta, logDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/WALs/jenkins-hbase4.apache.org,39755,1695481329466, archiveDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/oldWALs, maxLogs=32 2023-09-23 15:02:11,409 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44121,DS-6f15a4e2-2487-4690-9915-78e65741e015,DISK] 2023-09-23 15:02:11,409 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42441,DS-b875ba61-2321-47dc-93f4-5be17e15aca4,DISK] 2023-09-23 15:02:11,409 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40923,DS-dc6292b8-d8db-4a5d-aac5-4d004656d8bf,DISK] 2023-09-23 15:02:11,415 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/WALs/jenkins-hbase4.apache.org,39755,1695481329466/jenkins-hbase4.apache.org%2C39755%2C1695481329466.meta.1695481331388.meta 2023-09-23 15:02:11,416 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44121,DS-6f15a4e2-2487-4690-9915-78e65741e015,DISK], DatanodeInfoWithStorage[127.0.0.1:42441,DS-b875ba61-2321-47dc-93f4-5be17e15aca4,DISK], DatanodeInfoWithStorage[127.0.0.1:40923,DS-dc6292b8-d8db-4a5d-aac5-4d004656d8bf,DISK]] 2023-09-23 15:02:11,416 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-23 15:02:11,417 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-23 15:02:11,419 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:11,420 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-23 15:02:11,422 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-23 15:02:11,423 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-23 15:02:11,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-23 15:02:11,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:11,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-23 15:02:11,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-23 15:02:11,445 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-23 15:02:11,447 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/info 2023-09-23 15:02:11,447 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/info 2023-09-23 15:02:11,448 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-23 15:02:11,449 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:11,449 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-23 15:02:11,451 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/rep_barrier 2023-09-23 15:02:11,451 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/rep_barrier 2023-09-23 15:02:11,451 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-23 15:02:11,452 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:11,452 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-23 15:02:11,456 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/table 2023-09-23 15:02:11,456 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/table 2023-09-23 15:02:11,456 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-23 15:02:11,457 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:11,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740 2023-09-23 15:02:11,462 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740 2023-09-23 15:02:11,466 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-23 15:02:11,468 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-23 15:02:11,469 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67815134, jitterRate=0.010524243116378784}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-23 15:02:11,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-23 15:02:11,484 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695481331352 2023-09-23 15:02:11,508 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-23 15:02:11,509 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39755,1695481329466, state=OPEN 2023-09-23 15:02:11,510 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-23 15:02:11,515 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-23 15:02:11,515 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-23 15:02:11,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-23 15:02:11,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39755,1695481329466 in 348 msec 2023-09-23 15:02:11,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-23 15:02:11,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 558 msec 2023-09-23 15:02:11,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 807 msec 2023-09-23 15:02:11,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695481331531, completionTime=-1 2023-09-23 15:02:11,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-23 15:02:11,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-23 15:02:11,611 DEBUG [hconnection-0x584d500e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:11,614 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:11,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-23 15:02:11,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695481391636 2023-09-23 15:02:11,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695481451637 2023-09-23 15:02:11,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 104 msec 2023-09-23 15:02:11,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40555,1695481328153-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40555,1695481328153-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40555,1695481328153-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40555, period=300000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-23 15:02:11,678 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-23 15:02:11,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-23 15:02:11,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-23 15:02:11,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-23 15:02:11,701 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 15:02:11,704 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 15:02:11,726 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035 2023-09-23 15:02:11,729 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035 empty. 2023-09-23 15:02:11,730 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035 2023-09-23 15:02:11,730 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-23 15:02:11,771 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-23 15:02:11,774 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4b8b659b076874d3607df57b2ada0035, NAME => 'hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:02:11,794 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:11,794 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 4b8b659b076874d3607df57b2ada0035, disabling compactions & flushes 2023-09-23 15:02:11,794 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. 2023-09-23 15:02:11,794 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. 2023-09-23 15:02:11,794 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. after waiting 0 ms 2023-09-23 15:02:11,794 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. 2023-09-23 15:02:11,794 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. 2023-09-23 15:02:11,794 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 4b8b659b076874d3607df57b2ada0035: 2023-09-23 15:02:11,799 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 15:02:11,814 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695481331801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481331801"}]},"ts":"1695481331801"} 2023-09-23 15:02:11,843 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-23 15:02:11,845 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 15:02:11,850 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481331845"}]},"ts":"1695481331845"} 2023-09-23 15:02:11,857 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-23 15:02:11,862 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 15:02:11,863 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 15:02:11,863 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 15:02:11,863 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 15:02:11,863 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 15:02:11,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4b8b659b076874d3607df57b2ada0035, ASSIGN}] 2023-09-23 15:02:11,869 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4b8b659b076874d3607df57b2ada0035, ASSIGN 2023-09-23 15:02:11,872 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4b8b659b076874d3607df57b2ada0035, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39421,1695481329509; forceNewPlan=false, retain=false 2023-09-23 15:02:12,025 INFO [jenkins-hbase4:40555] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-23 15:02:12,026 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4b8b659b076874d3607df57b2ada0035, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:12,026 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695481332026"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481332026"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481332026"}]},"ts":"1695481332026"} 2023-09-23 15:02:12,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4b8b659b076874d3607df57b2ada0035, server=jenkins-hbase4.apache.org,39421,1695481329509}] 2023-09-23 15:02:12,186 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:12,187 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 15:02:12,190 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 15:02:12,199 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. 2023-09-23 15:02:12,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b8b659b076874d3607df57b2ada0035, NAME => 'hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035.', STARTKEY => '', ENDKEY => ''} 2023-09-23 15:02:12,200 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. service=AccessControlService 2023-09-23 15:02:12,200 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:12,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4b8b659b076874d3607df57b2ada0035 2023-09-23 15:02:12,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:12,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4b8b659b076874d3607df57b2ada0035 2023-09-23 15:02:12,201 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4b8b659b076874d3607df57b2ada0035 2023-09-23 15:02:12,203 INFO [StoreOpener-4b8b659b076874d3607df57b2ada0035-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4b8b659b076874d3607df57b2ada0035 2023-09-23 15:02:12,206 DEBUG [StoreOpener-4b8b659b076874d3607df57b2ada0035-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035/info 2023-09-23 15:02:12,206 DEBUG [StoreOpener-4b8b659b076874d3607df57b2ada0035-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035/info 2023-09-23 15:02:12,206 INFO [StoreOpener-4b8b659b076874d3607df57b2ada0035-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b8b659b076874d3607df57b2ada0035 columnFamilyName info 2023-09-23 15:02:12,207 INFO [StoreOpener-4b8b659b076874d3607df57b2ada0035-1] regionserver.HStore(310): Store=4b8b659b076874d3607df57b2ada0035/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:12,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035 2023-09-23 15:02:12,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035 2023-09-23 15:02:12,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4b8b659b076874d3607df57b2ada0035 2023-09-23 15:02:12,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:02:12,220 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4b8b659b076874d3607df57b2ada0035; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62249131, jitterRate=-0.07241566479206085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:02:12,220 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4b8b659b076874d3607df57b2ada0035: 2023-09-23 15:02:12,222 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035., pid=6, masterSystemTime=1695481332186 2023-09-23 15:02:12,227 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. 2023-09-23 15:02:12,227 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. 2023-09-23 15:02:12,229 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4b8b659b076874d3607df57b2ada0035, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:12,229 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695481332228"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481332228"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481332228"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481332228"}]},"ts":"1695481332228"} 2023-09-23 15:02:12,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-23 15:02:12,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4b8b659b076874d3607df57b2ada0035, server=jenkins-hbase4.apache.org,39421,1695481329509 in 200 msec 2023-09-23 15:02:12,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-23 15:02:12,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4b8b659b076874d3607df57b2ada0035, ASSIGN in 371 msec 2023-09-23 15:02:12,243 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 15:02:12,243 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481332243"}]},"ts":"1695481332243"} 2023-09-23 15:02:12,246 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-23 15:02:12,249 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 15:02:12,252 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 560 msec 2023-09-23 15:02:12,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-23 15:02:12,303 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-23 15:02:12,303 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 15:02:12,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:12,329 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:12,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-23 15:02:12,363 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-23 15:02:12,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-09-23 15:02:12,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-23 15:02:12,392 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-23 15:02:12,398 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-23 15:02:12,406 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-23 15:02:12,410 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-23 15:02:12,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.835sec 2023-09-23 15:02:12,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-23 15:02:12,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-23 15:02:12,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-23 15:02:12,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40555,1695481328153-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-23 15:02:12,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40555,1695481328153-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-23 15:02:12,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-23 15:02:12,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-23 15:02:12,444 DEBUG [Listener at localhost/35841] zookeeper.ReadOnlyZKClient(139): Connect 0x3a20d86f to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:12,446 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 15:02:12,449 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 15:02:12,451 DEBUG [Listener at localhost/35841] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3204b0f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:12,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-23 15:02:12,452 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2 2023-09-23 15:02:12,454 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2 empty. 2023-09-23 15:02:12,457 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2 2023-09-23 15:02:12,457 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-23 15:02:12,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 15:02:12,469 DEBUG [hconnection-0x5a782b32-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:12,488 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:12,494 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40555,1695481328153 2023-09-23 15:02:12,494 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-23 15:02:12,494 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-23 15:02:12,494 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/test.cache.data in system properties and HBase conf 2023-09-23 15:02:12,494 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop.tmp.dir in system properties and HBase conf 2023-09-23 15:02:12,494 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop.log.dir in system properties and HBase conf 2023-09-23 15:02:12,495 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-23 15:02:12,495 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-23 15:02:12,495 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-23 15:02:12,495 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-23 15:02:12,495 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-23 15:02:12,495 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-23 15:02:12,495 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 15:02:12,496 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-23 15:02:12,496 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => f60c13d8c45751bc6befef43bb40eff2, NAME => 'hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:02:12,496 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-23 15:02:12,496 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 15:02:12,496 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 15:02:12,496 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-23 15:02:12,496 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/nfs.dump.dir in system properties and HBase conf 2023-09-23 15:02:12,496 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/java.io.tmpdir in system properties and HBase conf 2023-09-23 15:02:12,497 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 15:02:12,497 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-23 15:02:12,497 INFO [Listener at localhost/35841] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-23 15:02:12,521 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:12,522 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing f60c13d8c45751bc6befef43bb40eff2, disabling compactions & flushes 2023-09-23 15:02:12,522 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. 2023-09-23 15:02:12,522 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. 2023-09-23 15:02:12,522 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. after waiting 0 ms 2023-09-23 15:02:12,522 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. 2023-09-23 15:02:12,522 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. 2023-09-23 15:02:12,522 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for f60c13d8c45751bc6befef43bb40eff2: 2023-09-23 15:02:12,527 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 15:02:12,529 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695481332529"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481332529"}]},"ts":"1695481332529"} 2023-09-23 15:02:12,532 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-23 15:02:12,534 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 15:02:12,535 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481332534"}]},"ts":"1695481332534"} 2023-09-23 15:02:12,538 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-23 15:02:12,543 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 15:02:12,544 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 15:02:12,545 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 15:02:12,545 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 15:02:12,545 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 15:02:12,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f60c13d8c45751bc6befef43bb40eff2, ASSIGN}] 2023-09-23 15:02:12,548 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f60c13d8c45751bc6befef43bb40eff2, ASSIGN 2023-09-23 15:02:12,550 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=f60c13d8c45751bc6befef43bb40eff2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39755,1695481329466; forceNewPlan=false, retain=false 2023-09-23 15:02:12,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 15:02:12,701 INFO [jenkins-hbase4:40555] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-23 15:02:12,702 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f60c13d8c45751bc6befef43bb40eff2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:12,702 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695481332702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481332702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481332702"}]},"ts":"1695481332702"} 2023-09-23 15:02:12,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f60c13d8c45751bc6befef43bb40eff2, server=jenkins-hbase4.apache.org,39755,1695481329466}] 2023-09-23 15:02:12,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 15:02:12,866 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. 2023-09-23 15:02:12,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f60c13d8c45751bc6befef43bb40eff2, NAME => 'hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2.', STARTKEY => '', ENDKEY => ''} 2023-09-23 15:02:12,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. service=AccessControlService 2023-09-23 15:02:12,867 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:12,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl f60c13d8c45751bc6befef43bb40eff2 2023-09-23 15:02:12,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:12,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f60c13d8c45751bc6befef43bb40eff2 2023-09-23 15:02:12,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f60c13d8c45751bc6befef43bb40eff2 2023-09-23 15:02:12,870 INFO [StoreOpener-f60c13d8c45751bc6befef43bb40eff2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region f60c13d8c45751bc6befef43bb40eff2 2023-09-23 15:02:12,872 DEBUG [StoreOpener-f60c13d8c45751bc6befef43bb40eff2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2/l 2023-09-23 15:02:12,872 DEBUG [StoreOpener-f60c13d8c45751bc6befef43bb40eff2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2/l 2023-09-23 15:02:12,873 INFO [StoreOpener-f60c13d8c45751bc6befef43bb40eff2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f60c13d8c45751bc6befef43bb40eff2 columnFamilyName l 2023-09-23 15:02:12,874 INFO [StoreOpener-f60c13d8c45751bc6befef43bb40eff2-1] regionserver.HStore(310): Store=f60c13d8c45751bc6befef43bb40eff2/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:12,877 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2 2023-09-23 15:02:12,879 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2 2023-09-23 15:02:12,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f60c13d8c45751bc6befef43bb40eff2 2023-09-23 15:02:12,889 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:02:12,893 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f60c13d8c45751bc6befef43bb40eff2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73055890, jitterRate=0.08861759305000305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:02:12,893 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f60c13d8c45751bc6befef43bb40eff2: 2023-09-23 15:02:12,898 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2., pid=11, masterSystemTime=1695481332859 2023-09-23 15:02:12,901 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. 2023-09-23 15:02:12,901 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. 2023-09-23 15:02:12,902 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f60c13d8c45751bc6befef43bb40eff2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:12,903 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695481332902"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481332902"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481332902"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481332902"}]},"ts":"1695481332902"} 2023-09-23 15:02:12,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-23 15:02:12,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f60c13d8c45751bc6befef43bb40eff2, server=jenkins-hbase4.apache.org,39755,1695481329466 in 200 msec 2023-09-23 15:02:12,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-23 15:02:12,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=f60c13d8c45751bc6befef43bb40eff2, ASSIGN in 365 msec 2023-09-23 15:02:12,916 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 15:02:12,916 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481332916"}]},"ts":"1695481332916"} 2023-09-23 15:02:12,919 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-23 15:02:12,924 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 15:02:12,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 484 msec 2023-09-23 15:02:13,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 15:02:13,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-23 15:02:13,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-23 15:02:13,838 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 15:02:14,219 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 15:02:14,226 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39595_jobhistory____8iiok4/webapp 2023-09-23 15:02:14,402 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-23 15:02:14,403 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-23 15:02:14,403 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 15:02:14,406 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 15:02:14,493 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 15:02:14,831 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 15:02:15,107 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-23 15:02:15,139 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39595 2023-09-23 15:02:15,335 WARN [Listener at jenkins-hbase4.apache.org/38159] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 15:02:15,641 WARN [Listener at jenkins-hbase4.apache.org/38159] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-23 15:02:15,642 INFO [Listener at jenkins-hbase4.apache.org/38159] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 15:02:15,649 INFO [Listener at jenkins-hbase4.apache.org/38159] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46093_cluster____84zr4s/webapp 2023-09-23 15:02:15,722 INFO [Listener at jenkins-hbase4.apache.org/38159] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-23 15:02:15,722 INFO [Listener at jenkins-hbase4.apache.org/38159] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-23 15:02:15,722 INFO [Listener at jenkins-hbase4.apache.org/38159] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 15:02:15,723 INFO [Listener at jenkins-hbase4.apache.org/38159] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 15:02:15,731 INFO [Listener at jenkins-hbase4.apache.org/38159] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 15:02:15,903 INFO [Listener at jenkins-hbase4.apache.org/38159] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 15:02:15,985 INFO [Listener at jenkins-hbase4.apache.org/38159] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 15:02:15,994 INFO [Listener at jenkins-hbase4.apache.org/38159] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46093 2023-09-23 15:02:16,534 WARN [Listener at jenkins-hbase4.apache.org/41085] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 15:02:16,561 WARN [Listener at jenkins-hbase4.apache.org/41085] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-23 15:02:16,562 INFO [Listener at jenkins-hbase4.apache.org/41085] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 15:02:16,571 INFO [Listener at jenkins-hbase4.apache.org/41085] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39885_node____cuz3nx/webapp 2023-09-23 15:02:16,623 INFO [Listener at jenkins-hbase4.apache.org/41085] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-23 15:02:16,624 INFO [Listener at jenkins-hbase4.apache.org/41085] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 15:02:16,624 INFO [Listener at jenkins-hbase4.apache.org/41085] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-23 15:02:16,624 INFO [Listener at jenkins-hbase4.apache.org/41085] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 15:02:16,632 INFO [Listener at jenkins-hbase4.apache.org/41085] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 15:02:16,653 INFO [Listener at jenkins-hbase4.apache.org/41085] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 15:02:16,719 INFO [Listener at jenkins-hbase4.apache.org/41085] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 15:02:16,730 INFO [Listener at jenkins-hbase4.apache.org/41085] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39885 2023-09-23 15:02:16,957 WARN [Listener at jenkins-hbase4.apache.org/46353] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 15:02:16,963 WARN [Listener at jenkins-hbase4.apache.org/46353] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-23 15:02:16,964 INFO [Listener at jenkins-hbase4.apache.org/46353] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 15:02:16,971 INFO [Listener at jenkins-hbase4.apache.org/46353] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45539_node____.eozuko/webapp 2023-09-23 15:02:17,017 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 15:02:17,031 INFO [Listener at jenkins-hbase4.apache.org/46353] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-23 15:02:17,031 INFO [Listener at jenkins-hbase4.apache.org/46353] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 15:02:17,031 INFO [Listener at jenkins-hbase4.apache.org/46353] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-23 15:02:17,034 INFO [Listener at jenkins-hbase4.apache.org/46353] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 15:02:17,063 INFO [Listener at jenkins-hbase4.apache.org/46353] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 15:02:17,100 INFO [Listener at jenkins-hbase4.apache.org/46353] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 15:02:17,204 INFO [Listener at jenkins-hbase4.apache.org/46353] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 15:02:17,209 INFO [Listener at jenkins-hbase4.apache.org/46353] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45539 2023-09-23 15:02:17,228 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-23 15:02:17,229 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-23 15:02:17,230 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-23 15:02:17,244 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-23 15:02:17,246 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:02:17,328 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=145, ProcessCount=165, AvailableMemoryMB=2305 2023-09-23 15:02:17,328 WARN [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-09-23 15:02:17,343 DEBUG [Listener at jenkins-hbase4.apache.org/46353] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-23 15:02:17,348 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-23 15:02:17,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 15:02:17,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-23 15:02:17,360 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 15:02:17,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-23 15:02:17,363 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 15:02:17,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 15:02:17,368 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:17,369 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:17,372 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f empty. 2023-09-23 15:02:17,372 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456 empty. 2023-09-23 15:02:17,373 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:17,373 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:17,374 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-23 15:02:17,406 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-23 15:02:17,408 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6e56810278cacfa650292591f0c5268f, NAME => 'testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:02:17,408 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8bb0a34ba9ef03def0ec253298333456, NAME => 'testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:02:17,439 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:17,440 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 6e56810278cacfa650292591f0c5268f, disabling compactions & flushes 2023-09-23 15:02:17,443 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:17,443 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:17,443 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. after waiting 0 ms 2023-09-23 15:02:17,443 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:17,443 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:17,443 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 6e56810278cacfa650292591f0c5268f: 2023-09-23 15:02:17,443 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:17,444 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 8bb0a34ba9ef03def0ec253298333456, disabling compactions & flushes 2023-09-23 15:02:17,444 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:17,444 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:17,444 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. after waiting 0 ms 2023-09-23 15:02:17,444 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:17,444 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:17,444 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 8bb0a34ba9ef03def0ec253298333456: 2023-09-23 15:02:17,448 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 15:02:17,450 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695481337450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481337450"}]},"ts":"1695481337450"} 2023-09-23 15:02:17,450 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695481337450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481337450"}]},"ts":"1695481337450"} 2023-09-23 15:02:17,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 15:02:17,503 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 15:02:17,505 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 15:02:17,506 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481337505"}]},"ts":"1695481337505"} 2023-09-23 15:02:17,508 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-23 15:02:17,513 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 15:02:17,515 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 15:02:17,515 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 15:02:17,515 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 15:02:17,515 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 15:02:17,515 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6e56810278cacfa650292591f0c5268f, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb0a34ba9ef03def0ec253298333456, ASSIGN}] 2023-09-23 15:02:17,519 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6e56810278cacfa650292591f0c5268f, ASSIGN 2023-09-23 15:02:17,519 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb0a34ba9ef03def0ec253298333456, ASSIGN 2023-09-23 15:02:17,520 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6e56810278cacfa650292591f0c5268f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39755,1695481329466; forceNewPlan=false, retain=false 2023-09-23 15:02:17,521 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb0a34ba9ef03def0ec253298333456, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40421,1695481329420; forceNewPlan=false, retain=false 2023-09-23 15:02:17,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 15:02:17,671 INFO [jenkins-hbase4:40555] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 15:02:17,674 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=6e56810278cacfa650292591f0c5268f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:17,674 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8bb0a34ba9ef03def0ec253298333456, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:17,675 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695481337674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481337674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481337674"}]},"ts":"1695481337674"} 2023-09-23 15:02:17,675 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695481337674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481337674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481337674"}]},"ts":"1695481337674"} 2023-09-23 15:02:17,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 6e56810278cacfa650292591f0c5268f, server=jenkins-hbase4.apache.org,39755,1695481329466}] 2023-09-23 15:02:17,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 8bb0a34ba9ef03def0ec253298333456, server=jenkins-hbase4.apache.org,40421,1695481329420}] 2023-09-23 15:02:17,834 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:17,834 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 15:02:17,838 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 15:02:17,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:17,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6e56810278cacfa650292591f0c5268f, NAME => 'testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 15:02:17,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. service=AccessControlService 2023-09-23 15:02:17,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:17,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:17,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:17,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:17,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:17,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:17,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8bb0a34ba9ef03def0ec253298333456, NAME => 'testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 15:02:17,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. service=AccessControlService 2023-09-23 15:02:17,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:17,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:17,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:17,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:17,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:17,858 INFO [StoreOpener-6e56810278cacfa650292591f0c5268f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:17,858 INFO [StoreOpener-8bb0a34ba9ef03def0ec253298333456-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:17,861 DEBUG [StoreOpener-8bb0a34ba9ef03def0ec253298333456-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/cf 2023-09-23 15:02:17,861 DEBUG [StoreOpener-6e56810278cacfa650292591f0c5268f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/cf 2023-09-23 15:02:17,861 DEBUG [StoreOpener-8bb0a34ba9ef03def0ec253298333456-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/cf 2023-09-23 15:02:17,861 DEBUG [StoreOpener-6e56810278cacfa650292591f0c5268f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/cf 2023-09-23 15:02:17,866 INFO [StoreOpener-8bb0a34ba9ef03def0ec253298333456-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8bb0a34ba9ef03def0ec253298333456 columnFamilyName cf 2023-09-23 15:02:17,866 INFO [StoreOpener-6e56810278cacfa650292591f0c5268f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e56810278cacfa650292591f0c5268f columnFamilyName cf 2023-09-23 15:02:17,869 INFO [StoreOpener-8bb0a34ba9ef03def0ec253298333456-1] regionserver.HStore(310): Store=8bb0a34ba9ef03def0ec253298333456/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:17,869 INFO [StoreOpener-6e56810278cacfa650292591f0c5268f-1] regionserver.HStore(310): Store=6e56810278cacfa650292591f0c5268f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:17,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:17,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:17,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:17,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:17,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:17,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:17,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:02:17,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:02:17,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8bb0a34ba9ef03def0ec253298333456; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74738910, jitterRate=0.11369654536247253}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:02:17,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8bb0a34ba9ef03def0ec253298333456: 2023-09-23 15:02:17,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6e56810278cacfa650292591f0c5268f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64879209, jitterRate=-0.033224448561668396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:02:17,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6e56810278cacfa650292591f0c5268f: 2023-09-23 15:02:17,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456., pid=16, masterSystemTime=1695481337833 2023-09-23 15:02:17,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f., pid=15, masterSystemTime=1695481337831 2023-09-23 15:02:17,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:17,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:17,899 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=6e56810278cacfa650292591f0c5268f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:17,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:17,899 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695481337899"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481337899"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481337899"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481337899"}]},"ts":"1695481337899"} 2023-09-23 15:02:17,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:17,901 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8bb0a34ba9ef03def0ec253298333456, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:17,902 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695481337901"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481337901"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481337901"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481337901"}]},"ts":"1695481337901"} 2023-09-23 15:02:17,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-23 15:02:17,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 6e56810278cacfa650292591f0c5268f, server=jenkins-hbase4.apache.org,39755,1695481329466 in 226 msec 2023-09-23 15:02:17,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-23 15:02:17,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 8bb0a34ba9ef03def0ec253298333456, server=jenkins-hbase4.apache.org,40421,1695481329420 in 227 msec 2023-09-23 15:02:17,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6e56810278cacfa650292591f0c5268f, ASSIGN in 393 msec 2023-09-23 15:02:17,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-23 15:02:17,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb0a34ba9ef03def0ec253298333456, ASSIGN in 398 msec 2023-09-23 15:02:17,924 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 15:02:17,924 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481337924"}]},"ts":"1695481337924"} 2023-09-23 15:02:17,927 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-23 15:02:17,931 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 15:02:17,937 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-23 15:02:17,958 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-23 15:02:17,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 15:02:17,991 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:17,991 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:17,991 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:17,991 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:17,991 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 15:02:18,000 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 15:02:18,000 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 15:02:18,000 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 15:02:18,000 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 15:02:18,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 645 msec 2023-09-23 15:02:18,326 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:02:18,327 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-23 15:02:18,327 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:02:18,327 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-23 15:02:18,327 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-23 15:02:18,328 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-23 15:02:18,328 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:02:18,328 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-23 15:02:18,328 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-23 15:02:18,328 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-23 15:02:18,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 15:02:18,472 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-23 15:02:18,476 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-23 15:02:18,477 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:18,480 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:02:18,509 DEBUG [hconnection-0x5a782b32-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:18,514 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:18,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 15:02:18,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481338529 (current time:1695481338529). 2023-09-23 15:02:18,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:02:18,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x72802e32 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:18,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dc78a5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:18,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:18,542 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:18,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72802e32 to 127.0.0.1:55260 2023-09-23 15:02:18,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:02:18,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x3589215d to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:18,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7632e6ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:18,557 DEBUG [hconnection-0x1daaec42-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:18,560 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:18,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3589215d to 127.0.0.1:55260 2023-09-23 15:02:18,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:02:18,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-23 15:02:18,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:02:18,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 15:02:18,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 15:02:18,616 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 15:02:18,617 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695481938617 2023-09-23 15:02:18,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 15:02:18,618 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-23 15:02:18,621 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 15:02:18,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 15:02:18,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-23 15:02:18,624 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 15:02:18,626 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695481938626 2023-09-23 15:02:18,626 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:02:18,626 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:02:18,643 WARN [DataStreamer for file /user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-09-23 15:02:18,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,655 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-23 15:02:18,655 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:18,656 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-23 15:02:18,656 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-23 15:02:18,657 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,657 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,662 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:18,662 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:18,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:18,662 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,662 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:18,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:18,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:18,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:18,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:18,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:18,663 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,663 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,664 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,664 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:02:18,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-23 15:02:18,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-23 15:02:18,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-23 15:02:18,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,666 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 15:02:18,666 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 15:02:18,666 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 15:02:18,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,669 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 15:02:18,669 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:18,669 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 15:02:18,671 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 15:02:18,671 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:18,671 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 15:02:18,672 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 15:02:18,672 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-23 15:02:18,672 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-23 15:02:18,672 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-23 15:02:18,671 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:18,672 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-23 15:02:18,673 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 15:02:18,673 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-23 15:02:18,673 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-23 15:02:18,676 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,676 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,676 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:18,676 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,676 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,676 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,677 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:18,677 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:18,677 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:18,677 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,677 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:18,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-23 15:02:18,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f9eec80[Count = 1] remaining members to acquire global barrier 2023-09-23 15:02:18,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:18,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:18,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:18,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:18,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:18,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:18,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-23 15:02:18,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f9eec80[Count = 0] remaining members to acquire global barrier 2023-09-23 15:02:18,683 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-23 15:02:18,683 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,686 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,686 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,686 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,686 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 15:02:18,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,686 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,687 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 15:02:18,687 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,687 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:02:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 15:02:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-23 15:02:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:02:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:02:18,688 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:02:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:02:18,688 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:02:18,688 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:18,688 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. started... 2023-09-23 15:02:18,688 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. started... 2023-09-23 15:02:18,691 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 15:02:18,692 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:18,692 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-23 15:02:18,693 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8bb0a34ba9ef03def0ec253298333456: 2023-09-23 15:02:18,693 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e56810278cacfa650292591f0c5268f: 2023-09-23 15:02:18,694 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,694 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,700 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:02:18,700 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:02:18,704 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 15:02:18,704 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 15:02:18,728 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:18,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 15:02:18,753 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. completed. 2023-09-23 15:02:18,753 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:18,754 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:02:18,754 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:02:18,754 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,754 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-23 15:02:18,754 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:02:18,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:02:18,756 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 15:02:18,756 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. completed. 2023-09-23 15:02:18,756 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:18,756 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:02:18,756 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:02:18,756 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,756 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-23 15:02:18,757 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:02:18,757 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 15:02:18,757 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,757 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:18,757 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-23 15:02:18,760 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 15:02:18,760 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:18,760 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:18,760 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-23 15:02:18,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:18,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:18,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:18,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39755,1695481329466': 2023-09-23 15:02:18,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-23 15:02:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:18,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:18,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:18,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40421,1695481329420': 2023-09-23 15:02:18,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-23 15:02:18,770 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-23 15:02:18,770 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:02:18,770 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:02:18,770 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,770 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:02:18,773 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,773 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,773 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,773 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:18,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,773 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:18,773 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:18,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:18,774 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:18,774 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:18,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:18,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:18,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:18,777 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,778 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:18,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,781 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:18,782 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,782 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,798 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,798 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:18,798 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:18,798 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:18,798 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:18,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:18,798 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:18,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:18,799 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:18,799 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:18,800 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-23 15:02:18,798 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:18,800 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:18,798 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:18,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:18,800 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:18,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:18,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:18,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 15:02:18,800 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:18,800 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:18,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:18,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:18,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:18,801 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,801 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:18,801 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:18,801 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,801 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 15:02:18,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,881 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-23 15:02:18,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,882 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:18,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695481338618Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695481338820 (+202 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695481338820Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695481338820Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695481338840 (+20 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695481338868 (+28 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695481338881 (+13 ms) 2023-09-23 15:02:18,884 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 15:02:18,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 265 msec 2023-09-23 15:02:18,956 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:18,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 15:02:18,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:02:18,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39755] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 15:02:18,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40421] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 15:02:18,982 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-23 15:02:18,982 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:18,983 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:02:19,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 15:02:19,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481339001 (current time:1695481339001). 2023-09-23 15:02:19,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:02:19,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x65f553e6 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:19,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@606d4c63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:19,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:19,014 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:19,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65f553e6 to 127.0.0.1:55260 2023-09-23 15:02:19,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:02:19,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x698884d9 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:19,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@262d906d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:19,025 DEBUG [hconnection-0x2ca9ce9f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:19,028 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:19,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x698884d9 to 127.0.0.1:55260 2023-09-23 15:02:19,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:02:19,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-23 15:02:19,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:02:19,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 15:02:19,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 15:02:19,039 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 15:02:19,040 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695481939040 2023-09-23 15:02:19,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-23 15:02:19,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 15:02:19,042 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:02:19,042 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:02:19,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 15:02:19,043 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 15:02:19,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-23 15:02:19,046 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 15:02:19,047 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695481939047 2023-09-23 15:02:19,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-23 15:02:19,064 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-23 15:02:19,064 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:19,065 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-23 15:02:19,065 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-23 15:02:19,066 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,066 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,067 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:19,068 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:19,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:19,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:19,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:19,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:19,068 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,067 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:19,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:19,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:19,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,068 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,068 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,069 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,069 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:02:19,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-23 15:02:19,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-23 15:02:19,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-23 15:02:19,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,070 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 15:02:19,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,070 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 15:02:19,070 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 15:02:19,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-23 15:02:19,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-23 15:02:19,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-23 15:02:19,070 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 15:02:19,070 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 15:02:19,070 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 15:02:19,070 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:19,070 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:19,070 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:19,072 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 15:02:19,073 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 15:02:19,073 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-23 15:02:19,071 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 15:02:19,073 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-23 15:02:19,073 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-23 15:02:19,073 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-23 15:02:19,073 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-23 15:02:19,073 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-23 15:02:19,076 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,076 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:19,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:19,076 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,076 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,076 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:19,076 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,077 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:19,077 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,077 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:19,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:19,077 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,077 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:19,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 15:02:19,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:19,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:19,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-23 15:02:19,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3831e83c[Count = 1] remaining members to acquire global barrier 2023-09-23 15:02:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:19,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:19,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:19,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 15:02:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:19,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-23 15:02:19,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3831e83c[Count = 0] remaining members to acquire global barrier 2023-09-23 15:02:19,082 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-23 15:02:19,082 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,088 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,089 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,089 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,089 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 15:02:19,089 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,089 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 15:02:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,089 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:02:19,089 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:19,089 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:02:19,089 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,089 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:02:19,089 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 15:02:19,090 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:02:19,089 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:02:19,089 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:19,089 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. started... 2023-09-23 15:02:19,090 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. started... 2023-09-23 15:02:19,090 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-23 15:02:19,090 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:02:19,090 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6e56810278cacfa650292591f0c5268f 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-23 15:02:19,090 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8bb0a34ba9ef03def0ec253298333456 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-23 15:02:19,093 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 15:02:19,093 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:19,093 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-23 15:02:19,142 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:19,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 15:02:19,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:02:19,144 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 15:02:19,238 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230923debb4bd1b6714c1daaedab7f561f4fda to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230923debb4bd1b6714c1daaedab7f561f4fda 2023-09-23 15:02:19,238 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309239ea206b8f23943d691507b8d2943177c to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309239ea206b8f23943d691507b8d2943177c 2023-09-23 15:02:19,279 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/.tmp/cf/5270d0eebe614920831b2dce6c38127c 2023-09-23 15:02:19,291 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/.tmp/cf/5270d0eebe614920831b2dce6c38127c as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/cf/5270d0eebe614920831b2dce6c38127c 2023-09-23 15:02:19,300 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/cf/5270d0eebe614920831b2dce6c38127c, entries=1, sequenceid=6, filesize=5.1 K 2023-09-23 15:02:19,303 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 6e56810278cacfa650292591f0c5268f in 213ms, sequenceid=6, compaction requested=false 2023-09-23 15:02:19,303 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-23 15:02:19,304 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e56810278cacfa650292591f0c5268f: 2023-09-23 15:02:19,304 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-23 15:02:19,304 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:02:19,304 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/cf/5270d0eebe614920831b2dce6c38127c] hfiles 2023-09-23 15:02:19,304 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/cf/5270d0eebe614920831b2dce6c38127c for snapshot=snaptb0-testExportWithTargetName 2023-09-23 15:02:19,324 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. completed. 2023-09-23 15:02:19,324 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:19,324 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:02:19,325 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:02:19,325 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,325 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-23 15:02:19,325 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:02:19,327 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 15:02:19,327 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,328 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:19,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:19,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:19,328 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-23 15:02:19,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:19,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:19,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 15:02:19,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:19,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:19,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 15:02:19,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:19,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39755,1695481329466': 2023-09-23 15:02:19,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-23 15:02:19,344 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:19,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 15:02:19,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:02:19,346 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-23 15:02:19,647 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:19,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 15:02:19,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:02:19,649 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-23 15:02:19,680 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/.tmp/cf/e769db11efd949a280182b5d02f76d43 2023-09-23 15:02:19,690 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/.tmp/cf/e769db11efd949a280182b5d02f76d43 as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/cf/e769db11efd949a280182b5d02f76d43 2023-09-23 15:02:19,698 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/cf/e769db11efd949a280182b5d02f76d43, entries=49, sequenceid=6, filesize=13.1 K 2023-09-23 15:02:19,701 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 8bb0a34ba9ef03def0ec253298333456 in 611ms, sequenceid=6, compaction requested=false 2023-09-23 15:02:19,703 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8bb0a34ba9ef03def0ec253298333456: 2023-09-23 15:02:19,703 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-23 15:02:19,703 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:02:19,703 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/cf/e769db11efd949a280182b5d02f76d43] hfiles 2023-09-23 15:02:19,703 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/cf/e769db11efd949a280182b5d02f76d43 for snapshot=snaptb0-testExportWithTargetName 2023-09-23 15:02:19,718 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. completed. 2023-09-23 15:02:19,719 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:19,719 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:02:19,720 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:02:19,720 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,720 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-23 15:02:19,720 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:02:19,723 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,723 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 15:02:19,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:19,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:19,723 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:19,723 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-23 15:02:19,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:19,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:19,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 15:02:19,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:19,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:19,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 15:02:19,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:19,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40421,1695481329420': 2023-09-23 15:02:19,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-23 15:02:19,729 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-23 15:02:19,729 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:02:19,729 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:02:19,729 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-23 15:02:19,729 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:02:19,731 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,731 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,731 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,731 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:19,731 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:19,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:19,731 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:19,731 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:19,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:19,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:19,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:19,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:19,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:19,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:19,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:19,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 15:02:19,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:19,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 15:02:19,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:19,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:19,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 15:02:19,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:19,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,737 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:19,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,738 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,738 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,740 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:19,741 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,741 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,754 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:19,754 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,754 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:19,754 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:19,754 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-23 15:02:19,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:19,754 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-23 15:02:19,754 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:19,754 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:19,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:19,754 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:19,754 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:19,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:19,754 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:19,755 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:19,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-23 15:02:19,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:19,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 15:02:19,755 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:19,756 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,756 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:19,756 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,756 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:19,756 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:19,756 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,756 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:19,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:19,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:19,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:19,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:19,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:19,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230923debb4bd1b6714c1daaedab7f561f4fda, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309239ea206b8f23943d691507b8d2943177c] mob files 2023-09-23 15:02:19,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230923debb4bd1b6714c1daaedab7f561f4fda 2023-09-23 15:02:19,758 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309239ea206b8f23943d691507b8d2943177c 2023-09-23 15:02:19,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-23 15:02:19,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-23 15:02:19,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,820 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-23 15:02:19,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695481339041Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695481339776 (+735 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695481339776Loading Region manifests for snaptb0-testExportWithTargetName at 1695481339776Writing data manifest for snaptb0-testExportWithTargetName at 1695481339781 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695481339804 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695481339819 (+15 ms) 2023-09-23 15:02:19,822 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 15:02:19,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 782 msec 2023-09-23 15:02:20,149 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:20,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 15:02:20,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:02:20,153 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481340153 2023-09-23 15:02:20,153 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35975, tgtDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481340153, rawTgtDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481340153, srcFsUri=hdfs://localhost:35975, srcDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:02:20,197 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:02:20,197 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-166733749_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481340153, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481340153/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-23 15:02:20,197 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8, snapshotDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-23 15:02:20,217 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481340153/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-23 15:02:20,282 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:20,283 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:20,283 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:20,283 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:21,217 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-3838402201440869037.jar 2023-09-23 15:02:21,218 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:21,218 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:21,288 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-3923330738949735374.jar 2023-09-23 15:02:21,289 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:21,289 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:21,290 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:21,290 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:21,291 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:21,291 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:21,292 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 15:02:21,293 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 15:02:21,294 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 15:02:21,294 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 15:02:21,294 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 15:02:21,295 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 15:02:21,296 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 15:02:21,296 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 15:02:21,296 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 15:02:21,297 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 15:02:21,301 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:02:21,301 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:02:21,302 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:02:21,302 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:02:21,302 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:02:21,303 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:02:21,304 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:02:22,581 WARN [Listener at jenkins-hbase4.apache.org/46353] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 15:02:22,587 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-23 15:02:22,596 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-23 15:02:23,086 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:02:23,088 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:02:23,356 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 15:02:23,430 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0001_000001 (auth:SIMPLE) 2023-09-23 15:02:27,924 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0001_000001 (auth:SIMPLE) 2023-09-23 15:02:30,211 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0001_000001 (auth:SIMPLE) 2023-09-23 15:02:33,085 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0001_000001 (auth:SIMPLE) 2023-09-23 15:02:34,527 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 15:02:34,532 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 15:02:34,547 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-23 15:02:34,548 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 15:02:34,549 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 15:02:34,549 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1038652771_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-23 15:02:34,549 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-23 15:02:34,549 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-23 15:02:34,550 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1038652771_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481340153/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481340153/.hbase-snapshot/testExportWithTargetName 2023-09-23 15:02:34,550 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481340153/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-23 15:02:34,550 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481340153/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-23 15:02:34,562 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-23 15:02:34,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-23 15:02:34,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-23 15:02:34,583 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481354583"}]},"ts":"1695481354583"} 2023-09-23 15:02:34,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-23 15:02:34,585 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-23 15:02:34,587 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-23 15:02:34,589 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6e56810278cacfa650292591f0c5268f, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb0a34ba9ef03def0ec253298333456, UNASSIGN}] 2023-09-23 15:02:34,592 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6e56810278cacfa650292591f0c5268f, UNASSIGN 2023-09-23 15:02:34,592 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb0a34ba9ef03def0ec253298333456, UNASSIGN 2023-09-23 15:02:34,593 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=6e56810278cacfa650292591f0c5268f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:34,593 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8bb0a34ba9ef03def0ec253298333456, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:34,593 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695481354593"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481354593"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481354593"}]},"ts":"1695481354593"} 2023-09-23 15:02:34,593 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695481354593"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481354593"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481354593"}]},"ts":"1695481354593"} 2023-09-23 15:02:34,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 6e56810278cacfa650292591f0c5268f, server=jenkins-hbase4.apache.org,39755,1695481329466}] 2023-09-23 15:02:34,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 8bb0a34ba9ef03def0ec253298333456, server=jenkins-hbase4.apache.org,40421,1695481329420}] 2023-09-23 15:02:34,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-23 15:02:34,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:34,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:34,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6e56810278cacfa650292591f0c5268f, disabling compactions & flushes 2023-09-23 15:02:34,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8bb0a34ba9ef03def0ec253298333456, disabling compactions & flushes 2023-09-23 15:02:34,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:34,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:34,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:34,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:34,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. after waiting 0 ms 2023-09-23 15:02:34,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. after waiting 0 ms 2023-09-23 15:02:34,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:34,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:34,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:02:34,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:02:34,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:02:34,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:02:34,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456. 2023-09-23 15:02:34,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f. 2023-09-23 15:02:34,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8bb0a34ba9ef03def0ec253298333456: 2023-09-23 15:02:34,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6e56810278cacfa650292591f0c5268f: 2023-09-23 15:02:34,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:34,783 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=6e56810278cacfa650292591f0c5268f, regionState=CLOSED 2023-09-23 15:02:34,783 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695481354783"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481354783"}]},"ts":"1695481354783"} 2023-09-23 15:02:34,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:34,784 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8bb0a34ba9ef03def0ec253298333456, regionState=CLOSED 2023-09-23 15:02:34,784 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695481354784"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481354784"}]},"ts":"1695481354784"} 2023-09-23 15:02:34,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-23 15:02:34,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 6e56810278cacfa650292591f0c5268f, server=jenkins-hbase4.apache.org,39755,1695481329466 in 189 msec 2023-09-23 15:02:34,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-23 15:02:34,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 8bb0a34ba9ef03def0ec253298333456, server=jenkins-hbase4.apache.org,40421,1695481329420 in 190 msec 2023-09-23 15:02:34,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=6e56810278cacfa650292591f0c5268f, UNASSIGN in 200 msec 2023-09-23 15:02:34,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-23 15:02:34,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8bb0a34ba9ef03def0ec253298333456, UNASSIGN in 200 msec 2023-09-23 15:02:34,793 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481354793"}]},"ts":"1695481354793"} 2023-09-23 15:02:34,795 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-23 15:02:34,796 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-23 15:02:34,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 226 msec 2023-09-23 15:02:34,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-23 15:02:34,887 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-23 15:02:34,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-23 15:02:34,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 15:02:34,910 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 15:02:34,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-23 15:02:34,912 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 15:02:34,915 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-23 15:02:34,919 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:34,919 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:34,919 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 15:02:34,919 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 15:02:34,919 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 15:02:34,919 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 15:02:34,923 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/recovered.edits] 2023-09-23 15:02:34,923 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/recovered.edits] 2023-09-23 15:02:34,925 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:34,925 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:34,925 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:34,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-23 15:02:34,926 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 15:02:34,925 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:34,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-23 15:02:34,926 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 15:02:34,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-23 15:02:34,926 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 15:02:34,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-23 15:02:34,926 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 15:02:34,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-23 15:02:34,933 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/cf/e769db11efd949a280182b5d02f76d43 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/cf/e769db11efd949a280182b5d02f76d43 2023-09-23 15:02:34,934 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/cf/5270d0eebe614920831b2dce6c38127c to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/cf/5270d0eebe614920831b2dce6c38127c 2023-09-23 15:02:34,938 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/recovered.edits/9.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456/recovered.edits/9.seqid 2023-09-23 15:02:34,938 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/recovered.edits/9.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f/recovered.edits/9.seqid 2023-09-23 15:02:34,939 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/8bb0a34ba9ef03def0ec253298333456 2023-09-23 15:02:34,939 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportWithTargetName/6e56810278cacfa650292591f0c5268f 2023-09-23 15:02:34,939 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-23 15:02:34,939 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-23 15:02:34,940 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-23 15:02:34,945 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230923debb4bd1b6714c1daaedab7f561f4fda to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230923debb4bd1b6714c1daaedab7f561f4fda 2023-09-23 15:02:34,946 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309239ea206b8f23943d691507b8d2943177c to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309239ea206b8f23943d691507b8d2943177c 2023-09-23 15:02:34,947 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-23 15:02:34,950 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 15:02:34,979 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-23 15:02:34,983 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-23 15:02:34,984 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 15:02:34,984 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-23 15:02:34,985 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481354984"}]},"ts":"9223372036854775807"} 2023-09-23 15:02:34,985 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481354984"}]},"ts":"9223372036854775807"} 2023-09-23 15:02:34,987 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 15:02:34,987 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6e56810278cacfa650292591f0c5268f, NAME => 'testtb-testExportWithTargetName,,1695481337354.6e56810278cacfa650292591f0c5268f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8bb0a34ba9ef03def0ec253298333456, NAME => 'testtb-testExportWithTargetName,1,1695481337354.8bb0a34ba9ef03def0ec253298333456.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 15:02:34,987 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-23 15:02:34,987 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695481354987"}]},"ts":"9223372036854775807"} 2023-09-23 15:02:34,989 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-23 15:02:34,992 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 15:02:34,994 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 96 msec 2023-09-23 15:02:35,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-23 15:02:35,033 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-23 15:02:35,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-23 15:02:35,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-23 15:02:35,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-23 15:02:35,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-23 15:02:35,100 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 707) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:41226 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:34861 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x584d500e-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1589506482_1 at /127.0.0.1:49712 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:49734 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:43345 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:46353 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1589506482_1 at /127.0.0.1:56254 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=178 (was 145) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=1529 (was 2305) 2023-09-23 15:02:35,101 WARN [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-23 15:02:35,122 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=178, ProcessCount=168, AvailableMemoryMB=1527 2023-09-23 15:02:35,122 WARN [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-23 15:02:35,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 15:02:35,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-23 15:02:35,130 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 15:02:35,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-23 15:02:35,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 15:02:35,133 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 15:02:35,136 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:35,139 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f empty. 2023-09-23 15:02:35,140 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:35,140 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:35,140 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc empty. 2023-09-23 15:02:35,141 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:35,141 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-23 15:02:35,158 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-23 15:02:35,159 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2a3def427f2482990d7b32f26f54ab6f, NAME => 'testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:02:35,160 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 14e83d4fa3c73663b89cd9772a6c7dcc, NAME => 'testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:02:35,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:35,183 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 14e83d4fa3c73663b89cd9772a6c7dcc, disabling compactions & flushes 2023-09-23 15:02:35,184 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:35,184 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:35,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2a3def427f2482990d7b32f26f54ab6f, disabling compactions & flushes 2023-09-23 15:02:35,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:35,185 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:35,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. after waiting 0 ms 2023-09-23 15:02:35,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:35,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. after waiting 0 ms 2023-09-23 15:02:35,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:35,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:35,185 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:35,185 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:35,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2a3def427f2482990d7b32f26f54ab6f: 2023-09-23 15:02:35,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 14e83d4fa3c73663b89cd9772a6c7dcc: 2023-09-23 15:02:35,188 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 15:02:35,189 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695481355189"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481355189"}]},"ts":"1695481355189"} 2023-09-23 15:02:35,189 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695481355189"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481355189"}]},"ts":"1695481355189"} 2023-09-23 15:02:35,192 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 15:02:35,193 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 15:02:35,193 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481355193"}]},"ts":"1695481355193"} 2023-09-23 15:02:35,195 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-23 15:02:35,200 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 15:02:35,201 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 15:02:35,201 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 15:02:35,201 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 15:02:35,201 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 15:02:35,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a3def427f2482990d7b32f26f54ab6f, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=14e83d4fa3c73663b89cd9772a6c7dcc, ASSIGN}] 2023-09-23 15:02:35,205 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=14e83d4fa3c73663b89cd9772a6c7dcc, ASSIGN 2023-09-23 15:02:35,205 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a3def427f2482990d7b32f26f54ab6f, ASSIGN 2023-09-23 15:02:35,206 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a3def427f2482990d7b32f26f54ab6f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40421,1695481329420; forceNewPlan=false, retain=false 2023-09-23 15:02:35,206 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=14e83d4fa3c73663b89cd9772a6c7dcc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39421,1695481329509; forceNewPlan=false, retain=false 2023-09-23 15:02:35,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 15:02:35,356 INFO [jenkins-hbase4:40555] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 15:02:35,359 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2a3def427f2482990d7b32f26f54ab6f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,359 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=14e83d4fa3c73663b89cd9772a6c7dcc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,360 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695481355359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481355359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481355359"}]},"ts":"1695481355359"} 2023-09-23 15:02:35,360 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695481355359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481355359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481355359"}]},"ts":"1695481355359"} 2023-09-23 15:02:35,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 2a3def427f2482990d7b32f26f54ab6f, server=jenkins-hbase4.apache.org,40421,1695481329420}] 2023-09-23 15:02:35,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 14e83d4fa3c73663b89cd9772a6c7dcc, server=jenkins-hbase4.apache.org,39421,1695481329509}] 2023-09-23 15:02:35,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 15:02:35,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:35,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2a3def427f2482990d7b32f26f54ab6f, NAME => 'testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 15:02:35,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. service=AccessControlService 2023-09-23 15:02:35,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:35,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:35,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:35,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:35,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:35,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:35,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 14e83d4fa3c73663b89cd9772a6c7dcc, NAME => 'testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 15:02:35,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. service=AccessControlService 2023-09-23 15:02:35,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:35,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:35,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:35,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:35,529 INFO [StoreOpener-2a3def427f2482990d7b32f26f54ab6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:35,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:35,531 INFO [StoreOpener-14e83d4fa3c73663b89cd9772a6c7dcc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:35,531 DEBUG [StoreOpener-2a3def427f2482990d7b32f26f54ab6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/cf 2023-09-23 15:02:35,531 DEBUG [StoreOpener-2a3def427f2482990d7b32f26f54ab6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/cf 2023-09-23 15:02:35,532 INFO [StoreOpener-2a3def427f2482990d7b32f26f54ab6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a3def427f2482990d7b32f26f54ab6f columnFamilyName cf 2023-09-23 15:02:35,532 DEBUG [StoreOpener-14e83d4fa3c73663b89cd9772a6c7dcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/cf 2023-09-23 15:02:35,532 DEBUG [StoreOpener-14e83d4fa3c73663b89cd9772a6c7dcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/cf 2023-09-23 15:02:35,533 INFO [StoreOpener-14e83d4fa3c73663b89cd9772a6c7dcc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14e83d4fa3c73663b89cd9772a6c7dcc columnFamilyName cf 2023-09-23 15:02:35,533 INFO [StoreOpener-2a3def427f2482990d7b32f26f54ab6f-1] regionserver.HStore(310): Store=2a3def427f2482990d7b32f26f54ab6f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:35,535 INFO [StoreOpener-14e83d4fa3c73663b89cd9772a6c7dcc-1] regionserver.HStore(310): Store=14e83d4fa3c73663b89cd9772a6c7dcc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:35,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:35,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:35,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:35,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:35,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:35,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:35,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:02:35,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:02:35,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 14e83d4fa3c73663b89cd9772a6c7dcc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67639731, jitterRate=0.007910534739494324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:02:35,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 14e83d4fa3c73663b89cd9772a6c7dcc: 2023-09-23 15:02:35,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2a3def427f2482990d7b32f26f54ab6f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62958997, jitterRate=-0.06183783710002899}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:02:35,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2a3def427f2482990d7b32f26f54ab6f: 2023-09-23 15:02:35,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc., pid=31, masterSystemTime=1695481355517 2023-09-23 15:02:35,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f., pid=30, masterSystemTime=1695481355516 2023-09-23 15:02:35,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:35,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:35,548 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=14e83d4fa3c73663b89cd9772a6c7dcc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:35,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:35,548 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695481355548"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481355548"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481355548"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481355548"}]},"ts":"1695481355548"} 2023-09-23 15:02:35,550 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2a3def427f2482990d7b32f26f54ab6f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,550 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695481355550"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481355550"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481355550"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481355550"}]},"ts":"1695481355550"} 2023-09-23 15:02:35,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-23 15:02:35,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 14e83d4fa3c73663b89cd9772a6c7dcc, server=jenkins-hbase4.apache.org,39421,1695481329509 in 187 msec 2023-09-23 15:02:35,557 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-23 15:02:35,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=14e83d4fa3c73663b89cd9772a6c7dcc, ASSIGN in 353 msec 2023-09-23 15:02:35,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 2a3def427f2482990d7b32f26f54ab6f, server=jenkins-hbase4.apache.org,40421,1695481329420 in 190 msec 2023-09-23 15:02:35,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-23 15:02:35,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a3def427f2482990d7b32f26f54ab6f, ASSIGN in 357 msec 2023-09-23 15:02:35,563 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 15:02:35,563 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481355563"}]},"ts":"1695481355563"} 2023-09-23 15:02:35,565 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-23 15:02:35,568 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 15:02:35,568 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-23 15:02:35,571 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 15:02:35,572 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:35,572 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:35,572 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:35,572 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:35,574 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 15:02:35,574 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 15:02:35,574 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 15:02:35,574 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 15:02:35,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 448 msec 2023-09-23 15:02:35,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 15:02:35,737 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-23 15:02:35,741 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-23 15:02:35,741 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:35,745 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:02:35,761 DEBUG [hconnection-0x5a782b32-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:35,765 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:35,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 15:02:35,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481355771 (current time:1695481355771). 2023-09-23 15:02:35,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:02:35,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x246cc954 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:35,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a255fa7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:35,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:35,791 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:35,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x246cc954 to 127.0.0.1:55260 2023-09-23 15:02:35,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:02:35,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x28b15750 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:35,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a550d7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:35,809 DEBUG [hconnection-0xaedbff1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:35,810 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:35,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28b15750 to 127.0.0.1:55260 2023-09-23 15:02:35,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:02:35,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 15:02:35,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:02:35,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 15:02:35,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 15:02:35,825 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 15:02:35,827 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695481955827 2023-09-23 15:02:35,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 15:02:35,827 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-23 15:02:35,828 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:02:35,830 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:02:35,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 15:02:35,832 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 15:02:35,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-09-23 15:02:35,836 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 15:02:35,838 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695481955838 2023-09-23 15:02:35,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,865 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-23 15:02:35,865 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:35,867 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-23 15:02:35,867 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-23 15:02:35,868 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,868 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,870 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:35,870 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:35,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:35,870 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:35,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:35,870 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:35,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:35,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:35,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:35,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,871 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,871 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,872 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,872 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:02:35,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-23 15:02:35,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 15:02:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-23 15:02:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-23 15:02:35,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 15:02:35,872 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 15:02:35,873 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:35,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 15:02:35,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,874 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 15:02:35,874 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:35,874 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 15:02:35,876 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 15:02:35,876 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-23 15:02:35,876 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-23 15:02:35,876 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-23 15:02:35,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,876 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-23 15:02:35,877 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 15:02:35,877 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:35,878 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 15:02:35,878 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-23 15:02:35,878 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-23 15:02:35,887 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,887 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,887 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:35,888 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,888 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,888 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:35,888 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:35,888 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,888 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:35,889 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,889 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:35,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-23 15:02:35,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e6df8f2[Count = 1] remaining members to acquire global barrier 2023-09-23 15:02:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:35,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-23 15:02:35,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e6df8f2[Count = 0] remaining members to acquire global barrier 2023-09-23 15:02:35,893 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 15:02:35,893 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,897 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,897 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,897 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,897 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 15:02:35,897 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 15:02:35,897 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,897 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 15:02:35,898 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:02:35,898 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:02:35,898 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:02:35,898 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:02:35,898 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-23 15:02:35,898 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:35,898 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:02:35,898 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. started... 2023-09-23 15:02:35,898 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:35,898 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. started... 2023-09-23 15:02:35,898 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,898 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:02:35,900 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a3def427f2482990d7b32f26f54ab6f: 2023-09-23 15:02:35,900 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 14e83d4fa3c73663b89cd9772a6c7dcc: 2023-09-23 15:02:35,900 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,900 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,900 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:02:35,900 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:02:35,900 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 15:02:35,901 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 15:02:35,902 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 15:02:35,902 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:35,902 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-23 15:02:35,925 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. completed. 2023-09-23 15:02:35,925 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:35,925 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:02:35,925 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:02:35,925 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,925 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-23 15:02:35,926 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:02:35,928 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,929 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 15:02:35,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,929 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:35,929 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-23 15:02:35,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:35,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:35,931 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:35,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:35,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:35,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 15:02:35,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:02:35,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,933 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. completed. 2023-09-23 15:02:35,933 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:35,933 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 15:02:35,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:35,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:35,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:35,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40421,1695481329420': 2023-09-23 15:02:35,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 15:02:35,937 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:02:35,937 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:02:35,937 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,937 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-23 15:02:35,937 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:02:35,944 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 15:02:35,944 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,944 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:35,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:35,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:35,944 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-23 15:02:35,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:35,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:35,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:35,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:35,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:35,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39421,1695481329509': 2023-09-23 15:02:35,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 15:02:35,951 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-23 15:02:35,951 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:02:35,951 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:02:35,951 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,951 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:02:35,953 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,953 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,953 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,953 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,953 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:35,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,953 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:35,953 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:35,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:35,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:35,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:35,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:35,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:35,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:35,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:35,955 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:35,955 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,956 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:35,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:35,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,958 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:35,958 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:35,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,959 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:35,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,962 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:35,963 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:35,963 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:35,963 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:35,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:35,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:35,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:35,963 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:35,963 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:35,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:35,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:35,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:35,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:35,964 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,964 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,964 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:35,964 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,964 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,964 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:35,964 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,964 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:35,964 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:35,964 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:35,964 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,964 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,964 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,966 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-23 15:02:35,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 15:02:35,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 15:02:35,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:35,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:36,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:36,010 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-23 15:02:36,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:36,011 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:36,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695481355828Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695481355978 (+150 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695481355978Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695481355978Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695481355984 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695481356000 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695481356010 (+10 ms) 2023-09-23 15:02:36,014 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 15:02:36,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 186 msec 2023-09-23 15:02:36,133 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:36,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 15:02:36,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:02:36,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40421] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 15:02:36,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39421] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 15:02:36,148 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-23 15:02:36,149 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:36,149 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:02:36,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 15:02:36,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481356163 (current time:1695481356163). 2023-09-23 15:02:36,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:02:36,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x35520302 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:36,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@177df72b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:36,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:36,185 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:36,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35520302 to 127.0.0.1:55260 2023-09-23 15:02:36,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:02:36,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x32e91e08 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:36,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fba2830, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:36,196 DEBUG [hconnection-0x3979bad1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:36,200 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:36,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32e91e08 to 127.0.0.1:55260 2023-09-23 15:02:36,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:02:36,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 15:02:36,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:02:36,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 15:02:36,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 15:02:36,213 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 15:02:36,214 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695481956214 2023-09-23 15:02:36,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 15:02:36,214 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-23 15:02:36,216 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:02:36,216 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:02:36,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 15:02:36,219 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 15:02:36,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-09-23 15:02:36,222 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 15:02:36,223 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695481956223 2023-09-23 15:02:36,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-23 15:02:36,244 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-23 15:02:36,244 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:36,245 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-23 15:02:36,246 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-23 15:02:36,246 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,246 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,248 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:36,248 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:36,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:36,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:36,248 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,248 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:36,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:36,249 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,249 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,250 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,250 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:02:36,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-23 15:02:36,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-23 15:02:36,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-23 15:02:36,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 15:02:36,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 15:02:36,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 15:02:36,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-23 15:02:36,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-23 15:02:36,251 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 15:02:36,251 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 15:02:36,251 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:36,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-23 15:02:36,253 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 15:02:36,253 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-23 15:02:36,253 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 15:02:36,251 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:36,253 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:36,253 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-23 15:02:36,255 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 15:02:36,255 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-23 15:02:36,255 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-23 15:02:36,254 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 15:02:36,255 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-23 15:02:36,255 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-23 15:02:36,264 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,264 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,264 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:36,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:36,264 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,264 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,265 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:36,265 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:36,264 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,265 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:36,265 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,265 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:36,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:36,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 15:02:36,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:36,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:36,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-23 15:02:36,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@466fe953[Count = 1] remaining members to acquire global barrier 2023-09-23 15:02:36,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:36,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:36,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:36,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 15:02:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:36,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-23 15:02:36,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@466fe953[Count = 0] remaining members to acquire global barrier 2023-09-23 15:02:36,269 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 15:02:36,269 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,270 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,270 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,270 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,271 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,271 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 15:02:36,271 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 15:02:36,271 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-23 15:02:36,271 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 15:02:36,271 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:02:36,271 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:02:36,271 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:36,271 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:02:36,271 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:02:36,271 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:02:36,271 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. started... 2023-09-23 15:02:36,271 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,272 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:02:36,271 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:36,272 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2a3def427f2482990d7b32f26f54ab6f 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-23 15:02:36,272 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. started... 2023-09-23 15:02:36,272 INFO [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 14e83d4fa3c73663b89cd9772a6c7dcc 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-23 15:02:36,274 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 15:02:36,274 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:36,274 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-23 15:02:36,303 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309235dbde199cfb34b66ac3a35386c76f370 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309235dbde199cfb34b66ac3a35386c76f370 2023-09-23 15:02:36,308 INFO [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309237c88595ee602428b87c1635402560a9f to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309237c88595ee602428b87c1635402560a9f 2023-09-23 15:02:36,316 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:36,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 15:02:36,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:02:36,323 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 15:02:36,330 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/.tmp/cf/66f99cdab5ec4481a957a40f7a614d22 2023-09-23 15:02:36,333 INFO [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/.tmp/cf/a5cd1b27a93c4b53af8be9a0790566cc 2023-09-23 15:02:36,339 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/.tmp/cf/66f99cdab5ec4481a957a40f7a614d22 as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/cf/66f99cdab5ec4481a957a40f7a614d22 2023-09-23 15:02:36,341 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/.tmp/cf/a5cd1b27a93c4b53af8be9a0790566cc as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/cf/a5cd1b27a93c4b53af8be9a0790566cc 2023-09-23 15:02:36,346 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/cf/66f99cdab5ec4481a957a40f7a614d22, entries=2, sequenceid=6, filesize=5.2 K 2023-09-23 15:02:36,347 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 2a3def427f2482990d7b32f26f54ab6f in 75ms, sequenceid=6, compaction requested=false 2023-09-23 15:02:36,347 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-23 15:02:36,348 INFO [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/cf/a5cd1b27a93c4b53af8be9a0790566cc, entries=48, sequenceid=6, filesize=13.0 K 2023-09-23 15:02:36,348 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a3def427f2482990d7b32f26f54ab6f: 2023-09-23 15:02:36,348 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-23 15:02:36,349 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:02:36,349 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/cf/66f99cdab5ec4481a957a40f7a614d22] hfiles 2023-09-23 15:02:36,349 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/cf/66f99cdab5ec4481a957a40f7a614d22 for snapshot=snaptb0-testExportFileSystemState 2023-09-23 15:02:36,349 INFO [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 14e83d4fa3c73663b89cd9772a6c7dcc in 77ms, sequenceid=6, compaction requested=false 2023-09-23 15:02:36,351 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 14e83d4fa3c73663b89cd9772a6c7dcc: 2023-09-23 15:02:36,352 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-23 15:02:36,352 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:02:36,352 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/cf/a5cd1b27a93c4b53af8be9a0790566cc] hfiles 2023-09-23 15:02:36,352 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/cf/a5cd1b27a93c4b53af8be9a0790566cc for snapshot=snaptb0-testExportFileSystemState 2023-09-23 15:02:36,368 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. completed. 2023-09-23 15:02:36,368 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:36,368 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:02:36,369 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:02:36,369 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,369 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-23 15:02:36,369 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:02:36,374 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 15:02:36,374 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,374 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:36,374 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-23 15:02:36,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:36,376 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. completed. 2023-09-23 15:02:36,376 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:36,376 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:02:36,376 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:02:36,376 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,377 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-23 15:02:36,377 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:02:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:36,378 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,378 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 15:02:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 15:02:36,378 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:36,379 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-23 15:02:36,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:36,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:36,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 15:02:36,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:36,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40421,1695481329420': 2023-09-23 15:02:36,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 15:02:36,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:36,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:36,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:36,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:36,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 15:02:36,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:36,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:36,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 15:02:36,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:36,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39421,1695481329509': 2023-09-23 15:02:36,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 15:02:36,387 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-23 15:02:36,388 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:02:36,388 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:02:36,388 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-23 15:02:36,388 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:02:36,392 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,392 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,392 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:36,392 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:36,392 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,392 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:36,393 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:36,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,393 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:36,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:36,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 15:02:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:36,394 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:36,394 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 15:02:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:36,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:36,396 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 15:02:36,397 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:36,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,397 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:36,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:36,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:36,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:36,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:36,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:36,401 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:36,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:36,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:36,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:36,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:36,401 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-23 15:02:36,401 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:36,401 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-23 15:02:36,401 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:36,401 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:36,403 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:36,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:36,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-23 15:02:36,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:36,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:36,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:36,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:36,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 15:02:36,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:36,403 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:36,403 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,404 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:36,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:36,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309237c88595ee602428b87c1635402560a9f, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309235dbde199cfb34b66ac3a35386c76f370] mob files 2023-09-23 15:02:36,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309237c88595ee602428b87c1635402560a9f 2023-09-23 15:02:36,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309235dbde199cfb34b66ac3a35386c76f370 2023-09-23 15:02:36,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-23 15:02:36,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,443 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-23 15:02:36,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,444 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695481356214Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695481356416 (+202 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695481356416Loading Region manifests for snaptb0-testExportFileSystemState at 1695481356416Writing data manifest for snaptb0-testExportFileSystemState at 1695481356421 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695481356433 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695481356443 (+10 ms) 2023-09-23 15:02:36,447 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 15:02:36,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 231 msec 2023-09-23 15:02:36,523 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:36,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 15:02:36,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:02:36,525 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481356525 2023-09-23 15:02:36,525 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35975, tgtDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481356525, rawTgtDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481356525, srcFsUri=hdfs://localhost:35975, srcDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:02:36,549 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:02:36,549 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_929085505_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481356525, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481356525/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,549 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8, snapshotDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-23 15:02:36,565 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481356525/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 15:02:36,595 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:36,595 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:36,596 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:36,596 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:37,507 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-7692407973081881768.jar 2023-09-23 15:02:37,508 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:37,508 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:37,576 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-5177204705249175409.jar 2023-09-23 15:02:37,576 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:37,577 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:37,577 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:37,578 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:37,578 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:37,578 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:37,579 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 15:02:37,579 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 15:02:37,579 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 15:02:37,580 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 15:02:37,580 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 15:02:37,581 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 15:02:37,581 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 15:02:37,581 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 15:02:37,582 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 15:02:37,582 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 15:02:37,583 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:02:37,583 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:02:37,584 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:02:37,584 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:02:37,585 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:02:37,585 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:02:37,586 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:02:38,076 WARN [Listener at jenkins-hbase4.apache.org/46353] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 15:02:38,079 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-23 15:02:38,081 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-23 15:02:39,294 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:02:39,294 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:02:39,301 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0001_000001 (auth:SIMPLE) 2023-09-23 15:02:39,919 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0002_000001 (auth:SIMPLE) 2023-09-23 15:02:40,370 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 15:02:44,257 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0002_000001 (auth:SIMPLE) 2023-09-23 15:02:46,509 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0002_000001 (auth:SIMPLE) 2023-09-23 15:02:49,800 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0002_000001 (auth:SIMPLE) 2023-09-23 15:02:51,280 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 15:02:51,281 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 15:02:51,290 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-23 15:02:51,290 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 15:02:51,291 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 15:02:51,291 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1038652771_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-23 15:02:51,291 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-23 15:02:51,291 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-23 15:02:51,291 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1038652771_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481356525/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481356525/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-23 15:02:51,292 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481356525/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-23 15:02:51,292 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481356525/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-23 15:02:51,300 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-23 15:02:51,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-23 15:02:51,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-23 15:02:51,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-23 15:02:51,306 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481371306"}]},"ts":"1695481371306"} 2023-09-23 15:02:51,308 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-23 15:02:51,309 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-23 15:02:51,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a3def427f2482990d7b32f26f54ab6f, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=14e83d4fa3c73663b89cd9772a6c7dcc, UNASSIGN}] 2023-09-23 15:02:51,313 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=14e83d4fa3c73663b89cd9772a6c7dcc, UNASSIGN 2023-09-23 15:02:51,313 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a3def427f2482990d7b32f26f54ab6f, UNASSIGN 2023-09-23 15:02:51,314 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=14e83d4fa3c73663b89cd9772a6c7dcc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:51,314 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2a3def427f2482990d7b32f26f54ab6f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:51,314 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695481371314"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481371314"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481371314"}]},"ts":"1695481371314"} 2023-09-23 15:02:51,314 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695481371314"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481371314"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481371314"}]},"ts":"1695481371314"} 2023-09-23 15:02:51,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 14e83d4fa3c73663b89cd9772a6c7dcc, server=jenkins-hbase4.apache.org,39421,1695481329509}] 2023-09-23 15:02:51,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 2a3def427f2482990d7b32f26f54ab6f, server=jenkins-hbase4.apache.org,40421,1695481329420}] 2023-09-23 15:02:51,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-23 15:02:51,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:51,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 14e83d4fa3c73663b89cd9772a6c7dcc, disabling compactions & flushes 2023-09-23 15:02:51,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:51,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:51,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. after waiting 0 ms 2023-09-23 15:02:51,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:51,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:51,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2a3def427f2482990d7b32f26f54ab6f, disabling compactions & flushes 2023-09-23 15:02:51,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:51,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:51,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. after waiting 0 ms 2023-09-23 15:02:51,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:51,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:02:51,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:02:51,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:02:51,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:02:51,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f. 2023-09-23 15:02:51,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2a3def427f2482990d7b32f26f54ab6f: 2023-09-23 15:02:51,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc. 2023-09-23 15:02:51,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 14e83d4fa3c73663b89cd9772a6c7dcc: 2023-09-23 15:02:51,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:51,490 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2a3def427f2482990d7b32f26f54ab6f, regionState=CLOSED 2023-09-23 15:02:51,490 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695481371489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481371489"}]},"ts":"1695481371489"} 2023-09-23 15:02:51,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:51,490 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=14e83d4fa3c73663b89cd9772a6c7dcc, regionState=CLOSED 2023-09-23 15:02:51,491 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695481371490"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481371490"}]},"ts":"1695481371490"} 2023-09-23 15:02:51,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-23 15:02:51,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 2a3def427f2482990d7b32f26f54ab6f, server=jenkins-hbase4.apache.org,40421,1695481329420 in 175 msec 2023-09-23 15:02:51,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-23 15:02:51,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 14e83d4fa3c73663b89cd9772a6c7dcc, server=jenkins-hbase4.apache.org,39421,1695481329509 in 177 msec 2023-09-23 15:02:51,495 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2a3def427f2482990d7b32f26f54ab6f, UNASSIGN in 184 msec 2023-09-23 15:02:51,496 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-23 15:02:51,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=14e83d4fa3c73663b89cd9772a6c7dcc, UNASSIGN in 184 msec 2023-09-23 15:02:51,497 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481371497"}]},"ts":"1695481371497"} 2023-09-23 15:02:51,499 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-23 15:02:51,500 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-23 15:02:51,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 200 msec 2023-09-23 15:02:51,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-23 15:02:51,609 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-23 15:02:51,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-23 15:02:51,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 15:02:51,614 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 15:02:51,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-23 15:02:51,615 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 15:02:51,617 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-23 15:02:51,620 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:51,620 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:51,621 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 15:02:51,621 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 15:02:51,621 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 15:02:51,621 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 15:02:51,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 15:02:51,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 15:02:51,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 15:02:51,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 15:02:51,623 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/recovered.edits] 2023-09-23 15:02:51,623 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 15:02:51,623 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:51,623 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 15:02:51,623 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 15:02:51,623 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:51,623 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 15:02:51,624 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/recovered.edits] 2023-09-23 15:02:51,624 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:51,623 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:51,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-23 15:02:51,629 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/cf/a5cd1b27a93c4b53af8be9a0790566cc to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/cf/a5cd1b27a93c4b53af8be9a0790566cc 2023-09-23 15:02:51,631 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/cf/66f99cdab5ec4481a957a40f7a614d22 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/cf/66f99cdab5ec4481a957a40f7a614d22 2023-09-23 15:02:51,633 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/recovered.edits/9.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc/recovered.edits/9.seqid 2023-09-23 15:02:51,634 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/14e83d4fa3c73663b89cd9772a6c7dcc 2023-09-23 15:02:51,634 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/recovered.edits/9.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f/recovered.edits/9.seqid 2023-09-23 15:02:51,635 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemState/2a3def427f2482990d7b32f26f54ab6f 2023-09-23 15:02:51,635 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-23 15:02:51,635 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-23 15:02:51,636 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-23 15:02:51,640 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309237c88595ee602428b87c1635402560a9f to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309237c88595ee602428b87c1635402560a9f 2023-09-23 15:02:51,642 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309235dbde199cfb34b66ac3a35386c76f370 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309235dbde199cfb34b66ac3a35386c76f370 2023-09-23 15:02:51,642 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-23 15:02:51,645 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 15:02:51,648 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-23 15:02:51,650 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-23 15:02:51,652 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 15:02:51,652 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-23 15:02:51,652 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481371652"}]},"ts":"9223372036854775807"} 2023-09-23 15:02:51,652 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481371652"}]},"ts":"9223372036854775807"} 2023-09-23 15:02:51,655 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 15:02:51,655 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2a3def427f2482990d7b32f26f54ab6f, NAME => 'testtb-testExportFileSystemState,,1695481355124.2a3def427f2482990d7b32f26f54ab6f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 14e83d4fa3c73663b89cd9772a6c7dcc, NAME => 'testtb-testExportFileSystemState,1,1695481355124.14e83d4fa3c73663b89cd9772a6c7dcc.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 15:02:51,655 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-23 15:02:51,655 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695481371655"}]},"ts":"9223372036854775807"} 2023-09-23 15:02:51,657 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-23 15:02:51,660 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 15:02:51,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 50 msec 2023-09-23 15:02:51,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-23 15:02:51,726 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-23 15:02:51,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-23 15:02:51,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-23 15:02:51,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-23 15:02:51,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-23 15:02:51,774 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 754) Potentially hanging thread: hconnection-0x584d500e-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:43485 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x584d500e-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-598111840_1 at /127.0.0.1:37646 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1965 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:37656 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:56658 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 918) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=190 (was 178) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1383 (was 1527) 2023-09-23 15:02:51,774 WARN [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-23 15:02:51,795 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=190, ProcessCount=168, AvailableMemoryMB=1382 2023-09-23 15:02:51,795 WARN [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-23 15:02:51,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 15:02:51,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-23 15:02:51,802 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 15:02:51,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-23 15:02:51,804 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 15:02:51,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 15:02:51,807 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:02:51,807 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:02:51,807 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9 empty. 2023-09-23 15:02:51,807 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef empty. 2023-09-23 15:02:51,808 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:02:51,808 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:02:51,808 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-23 15:02:51,820 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-23 15:02:51,821 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => ebca342aa9c1feaebbf4ea72e7b5ada9, NAME => 'testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:02:51,822 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => bc6b7b17baa9be743ad9a0643b1be1ef, NAME => 'testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:02:51,841 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:51,841 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:51,841 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing ebca342aa9c1feaebbf4ea72e7b5ada9, disabling compactions & flushes 2023-09-23 15:02:51,841 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing bc6b7b17baa9be743ad9a0643b1be1ef, disabling compactions & flushes 2023-09-23 15:02:51,841 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:51,841 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:02:51,841 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:51,841 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:02:51,841 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. after waiting 0 ms 2023-09-23 15:02:51,841 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. after waiting 0 ms 2023-09-23 15:02:51,841 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:51,842 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:02:51,842 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:51,842 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:02:51,842 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for ebca342aa9c1feaebbf4ea72e7b5ada9: 2023-09-23 15:02:51,842 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for bc6b7b17baa9be743ad9a0643b1be1ef: 2023-09-23 15:02:51,845 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 15:02:51,846 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695481371846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481371846"}]},"ts":"1695481371846"} 2023-09-23 15:02:51,846 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695481371846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481371846"}]},"ts":"1695481371846"} 2023-09-23 15:02:51,849 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 15:02:51,850 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 15:02:51,850 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481371850"}]},"ts":"1695481371850"} 2023-09-23 15:02:51,852 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-23 15:02:51,857 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 15:02:51,858 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 15:02:51,858 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 15:02:51,858 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 15:02:51,858 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 15:02:51,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ebca342aa9c1feaebbf4ea72e7b5ada9, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bc6b7b17baa9be743ad9a0643b1be1ef, ASSIGN}] 2023-09-23 15:02:51,865 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bc6b7b17baa9be743ad9a0643b1be1ef, ASSIGN 2023-09-23 15:02:51,865 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ebca342aa9c1feaebbf4ea72e7b5ada9, ASSIGN 2023-09-23 15:02:51,866 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ebca342aa9c1feaebbf4ea72e7b5ada9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39755,1695481329466; forceNewPlan=false, retain=false 2023-09-23 15:02:51,866 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bc6b7b17baa9be743ad9a0643b1be1ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40421,1695481329420; forceNewPlan=false, retain=false 2023-09-23 15:02:51,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 15:02:52,016 INFO [jenkins-hbase4:40555] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 15:02:52,019 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=bc6b7b17baa9be743ad9a0643b1be1ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,019 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ebca342aa9c1feaebbf4ea72e7b5ada9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,019 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695481372019"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481372019"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481372019"}]},"ts":"1695481372019"} 2023-09-23 15:02:52,019 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695481372019"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481372019"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481372019"}]},"ts":"1695481372019"} 2023-09-23 15:02:52,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure ebca342aa9c1feaebbf4ea72e7b5ada9, server=jenkins-hbase4.apache.org,39755,1695481329466}] 2023-09-23 15:02:52,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure bc6b7b17baa9be743ad9a0643b1be1ef, server=jenkins-hbase4.apache.org,40421,1695481329420}] 2023-09-23 15:02:52,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 15:02:52,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:02:52,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bc6b7b17baa9be743ad9a0643b1be1ef, NAME => 'testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 15:02:52,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. service=AccessControlService 2023-09-23 15:02:52,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:52,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:52,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ebca342aa9c1feaebbf4ea72e7b5ada9, NAME => 'testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 15:02:52,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:02:52,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:52,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. service=AccessControlService 2023-09-23 15:02:52,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:02:52,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:02:52,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:02:52,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:02:52,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:02:52,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:02:52,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:02:52,183 INFO [StoreOpener-bc6b7b17baa9be743ad9a0643b1be1ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:02:52,184 INFO [StoreOpener-ebca342aa9c1feaebbf4ea72e7b5ada9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:02:52,185 DEBUG [StoreOpener-bc6b7b17baa9be743ad9a0643b1be1ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/cf 2023-09-23 15:02:52,185 DEBUG [StoreOpener-bc6b7b17baa9be743ad9a0643b1be1ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/cf 2023-09-23 15:02:52,185 DEBUG [StoreOpener-ebca342aa9c1feaebbf4ea72e7b5ada9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/cf 2023-09-23 15:02:52,185 DEBUG [StoreOpener-ebca342aa9c1feaebbf4ea72e7b5ada9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/cf 2023-09-23 15:02:52,185 INFO [StoreOpener-bc6b7b17baa9be743ad9a0643b1be1ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc6b7b17baa9be743ad9a0643b1be1ef columnFamilyName cf 2023-09-23 15:02:52,185 INFO [StoreOpener-ebca342aa9c1feaebbf4ea72e7b5ada9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ebca342aa9c1feaebbf4ea72e7b5ada9 columnFamilyName cf 2023-09-23 15:02:52,187 INFO [StoreOpener-bc6b7b17baa9be743ad9a0643b1be1ef-1] regionserver.HStore(310): Store=bc6b7b17baa9be743ad9a0643b1be1ef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:52,187 INFO [StoreOpener-ebca342aa9c1feaebbf4ea72e7b5ada9-1] regionserver.HStore(310): Store=ebca342aa9c1feaebbf4ea72e7b5ada9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:02:52,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:02:52,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:02:52,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:02:52,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:02:52,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:02:52,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:02:52,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:02:52,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:02:52,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bc6b7b17baa9be743ad9a0643b1be1ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69326856, jitterRate=0.03305065631866455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:02:52,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bc6b7b17baa9be743ad9a0643b1be1ef: 2023-09-23 15:02:52,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ebca342aa9c1feaebbf4ea72e7b5ada9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71832145, jitterRate=0.07038237154483795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:02:52,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ebca342aa9c1feaebbf4ea72e7b5ada9: 2023-09-23 15:02:52,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef., pid=46, masterSystemTime=1695481372174 2023-09-23 15:02:52,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9., pid=45, masterSystemTime=1695481372174 2023-09-23 15:02:52,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:02:52,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:02:52,198 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=bc6b7b17baa9be743ad9a0643b1be1ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,198 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695481372198"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481372198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481372198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481372198"}]},"ts":"1695481372198"} 2023-09-23 15:02:52,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:52,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:52,199 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ebca342aa9c1feaebbf4ea72e7b5ada9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,200 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695481372199"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481372199"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481372199"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481372199"}]},"ts":"1695481372199"} 2023-09-23 15:02:52,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-23 15:02:52,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure bc6b7b17baa9be743ad9a0643b1be1ef, server=jenkins-hbase4.apache.org,40421,1695481329420 in 177 msec 2023-09-23 15:02:52,203 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-23 15:02:52,203 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure ebca342aa9c1feaebbf4ea72e7b5ada9, server=jenkins-hbase4.apache.org,39755,1695481329466 in 180 msec 2023-09-23 15:02:52,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bc6b7b17baa9be743ad9a0643b1be1ef, ASSIGN in 343 msec 2023-09-23 15:02:52,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-23 15:02:52,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ebca342aa9c1feaebbf4ea72e7b5ada9, ASSIGN in 344 msec 2023-09-23 15:02:52,207 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 15:02:52,207 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481372207"}]},"ts":"1695481372207"} 2023-09-23 15:02:52,208 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-23 15:02:52,211 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 15:02:52,211 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-23 15:02:52,213 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-23 15:02:52,215 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:52,215 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:52,215 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:52,215 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:02:52,217 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 15:02:52,217 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 15:02:52,217 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 15:02:52,217 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 15:02:52,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 419 msec 2023-09-23 15:02:52,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 15:02:52,409 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-23 15:02:52,412 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-23 15:02:52,412 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:52,414 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:02:52,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 15:02:52,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481372428 (current time:1695481372428). 2023-09-23 15:02:52,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:02:52,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x4b78393d to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:52,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b9a0b70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:52,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:52,440 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:52,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b78393d to 127.0.0.1:55260 2023-09-23 15:02:52,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:02:52,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x22e062bc to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:52,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@285b060c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:52,452 DEBUG [hconnection-0x53e149fc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:52,456 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:52,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22e062bc to 127.0.0.1:55260 2023-09-23 15:02:52,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:02:52,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-23 15:02:52,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:02:52,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 15:02:52,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 15:02:52,467 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 15:02:52,468 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695481972468 2023-09-23 15:02:52,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-23 15:02:52,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 15:02:52,470 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:02:52,470 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:02:52,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 15:02:52,471 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 15:02:52,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-23 15:02:52,474 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 15:02:52,474 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695481972474 2023-09-23 15:02:52,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,486 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-23 15:02:52,486 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:52,488 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-23 15:02:52,488 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-23 15:02:52,488 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,488 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,494 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:52,494 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:52,494 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:52,494 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:52,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:52,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:52,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:52,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:52,495 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,495 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:52,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,495 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,495 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,496 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 15:02:52,497 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 15:02:52,497 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:52,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,498 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 15:02:52,498 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-23 15:02:52,498 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 15:02:52,498 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-23 15:02:52,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,498 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:52,499 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 15:02:52,500 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:52,500 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 15:02:52,503 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-23 15:02:52,503 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 15:02:52,504 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-23 15:02:52,503 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-23 15:02:52,504 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-23 15:02:52,505 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,505 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:52,506 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,506 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,507 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,507 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,507 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:52,507 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:52,507 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:52,507 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,507 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:52,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:52,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:52,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-23 15:02:52,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@712889aa[Count = 1] remaining members to acquire global barrier 2023-09-23 15:02:52,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:52,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:52,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:52,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:52,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:52,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-23 15:02:52,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@712889aa[Count = 0] remaining members to acquire global barrier 2023-09-23 15:02:52,512 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-23 15:02:52,512 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,515 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,515 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,515 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,515 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 15:02:52,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,515 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,515 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:02:52,515 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 15:02:52,515 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 15:02:52,515 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:52,515 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:02:52,515 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:02:52,515 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:02:52,515 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,516 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:02:52,515 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-23 15:02:52,516 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. started... 2023-09-23 15:02:52,515 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:02:52,515 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. started... 2023-09-23 15:02:52,516 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:02:52,517 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bc6b7b17baa9be743ad9a0643b1be1ef: 2023-09-23 15:02:52,517 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ebca342aa9c1feaebbf4ea72e7b5ada9: 2023-09-23 15:02:52,518 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,518 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,519 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:02:52,519 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:02:52,519 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 15:02:52,519 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 15:02:52,528 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 15:02:52,528 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:52,528 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-23 15:02:52,537 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. completed. 2023-09-23 15:02:52,537 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:52,537 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:02:52,537 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:02:52,537 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-23 15:02:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:02:52,538 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. completed. 2023-09-23 15:02:52,538 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:02:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:02:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:02:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-23 15:02:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:02:52,539 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 15:02:52,539 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,539 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:52,539 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-23 15:02:52,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:52,542 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 15:02:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-23 15:02:52,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:52,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:52,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:52,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39755,1695481329466': 2023-09-23 15:02:52,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-23 15:02:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:52,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40421,1695481329420': 2023-09-23 15:02:52,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-23 15:02:52,552 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-23 15:02:52,552 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:02:52,552 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:02:52,553 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,553 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:02:52,554 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,554 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,554 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:52,554 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:52,554 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,554 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:52,555 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:52,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:52,555 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:52,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:52,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:52,555 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,556 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,558 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:52,558 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,558 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:52,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,562 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:52,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:52,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,562 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:52,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:52,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:52,562 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:52,564 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:52,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:52,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-23 15:02:52,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:52,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:52,564 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:52,564 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:52,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:52,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:52,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:52,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 15:02:52,565 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,565 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 15:02:52,570 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:52,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 15:02:52,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:02:52,571 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 15:02:52,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,593 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-23 15:02:52,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,594 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-23 15:02:52,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695481372468Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695481372574 (+106 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695481372574Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695481372574Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695481372577 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695481372587 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695481372593 (+6 ms) 2023-09-23 15:02:52,596 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 15:02:52,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 128 msec 2023-09-23 15:02:52,772 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:52,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 15:02:52,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:02:52,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39755] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 15:02:52,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40421] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 15:02:52,781 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-23 15:02:52,781 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:52,781 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:02:52,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 15:02:52,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481372793 (current time:1695481372793). 2023-09-23 15:02:52,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:02:52,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x7b426068 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:52,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fdc7b0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:52,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:52,812 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:52,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b426068 to 127.0.0.1:55260 2023-09-23 15:02:52,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:02:52,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x0e440c57 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:02:52,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66ed7cd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:02:52,826 DEBUG [hconnection-0x6a657706-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:02:52,827 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:02:52,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e440c57 to 127.0.0.1:55260 2023-09-23 15:02:52,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:02:52,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-23 15:02:52,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:02:52,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 15:02:52,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 15:02:52,839 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 15:02:52,840 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695481972840 2023-09-23 15:02:52,840 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-23 15:02:52,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 15:02:52,842 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:02:52,842 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:02:52,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 15:02:52,844 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 15:02:52,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-23 15:02:52,846 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 15:02:52,847 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695481972847 2023-09-23 15:02:52,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-23 15:02:52,861 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-23 15:02:52,861 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:52,863 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-23 15:02:52,863 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-23 15:02:52,863 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,863 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,865 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:52,865 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:52,865 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:52,865 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:52,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:52,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:52,865 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,865 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,866 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,866 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:02:52,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-23 15:02:52,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-23 15:02:52,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-23 15:02:52,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 15:02:52,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 15:02:52,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 15:02:52,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-23 15:02:52,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-23 15:02:52,867 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 15:02:52,867 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 15:02:52,867 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:52,867 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:52,869 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 15:02:52,870 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 15:02:52,870 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-23 15:02:52,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-23 15:02:52,870 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-23 15:02:52,870 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 15:02:52,870 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:02:52,870 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-23 15:02:52,871 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 15:02:52,871 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-23 15:02:52,871 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-23 15:02:52,871 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-23 15:02:52,873 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,873 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,873 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,873 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,874 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:52,874 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,873 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:52,874 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,874 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:52,874 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:52,874 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:02:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:52,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 15:02:52,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:52,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-23 15:02:52,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@866eb48[Count = 1] remaining members to acquire global barrier 2023-09-23 15:02:52,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:52,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:52,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:52,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:52,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 15:02:52,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:52,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-23 15:02:52,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@866eb48[Count = 0] remaining members to acquire global barrier 2023-09-23 15:02:52,879 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-23 15:02:52,879 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,881 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,881 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,881 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,882 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 15:02:52,882 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,882 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 15:02:52,882 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 15:02:52,882 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:02:52,882 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:02:52,882 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-23 15:02:52,882 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:02:52,882 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:02:52,882 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:02:52,882 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,882 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. started... 2023-09-23 15:02:52,882 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:02:52,882 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:02:52,882 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:52,883 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. started... 2023-09-23 15:02:52,883 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bc6b7b17baa9be743ad9a0643b1be1ef 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-23 15:02:52,883 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ebca342aa9c1feaebbf4ea72e7b5ada9 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-23 15:02:52,884 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 15:02:52,885 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:52,885 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-23 15:02:52,906 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309237189726dc991401e88af6dd8fc41936c to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309237189726dc991401e88af6dd8fc41936c 2023-09-23 15:02:52,907 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230923adfcc100c6004760ab839c72d96a9094 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230923adfcc100c6004760ab839c72d96a9094 2023-09-23 15:02:52,922 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/.tmp/cf/e3e21ea50c2d45399bd1ef187f3b498a 2023-09-23 15:02:52,923 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/.tmp/cf/d47a771bbee94b55a6d00f4c71996337 2023-09-23 15:02:52,928 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/.tmp/cf/d47a771bbee94b55a6d00f4c71996337 as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/cf/d47a771bbee94b55a6d00f4c71996337 2023-09-23 15:02:52,928 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/.tmp/cf/e3e21ea50c2d45399bd1ef187f3b498a as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/cf/e3e21ea50c2d45399bd1ef187f3b498a 2023-09-23 15:02:52,933 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/cf/e3e21ea50c2d45399bd1ef187f3b498a, entries=47, sequenceid=6, filesize=12.7 K 2023-09-23 15:02:52,933 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/cf/d47a771bbee94b55a6d00f4c71996337, entries=3, sequenceid=6, filesize=5.4 K 2023-09-23 15:02:52,935 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ebca342aa9c1feaebbf4ea72e7b5ada9 in 52ms, sequenceid=6, compaction requested=false 2023-09-23 15:02:52,935 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for bc6b7b17baa9be743ad9a0643b1be1ef in 52ms, sequenceid=6, compaction requested=false 2023-09-23 15:02:52,935 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-23 15:02:52,935 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-23 15:02:52,937 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ebca342aa9c1feaebbf4ea72e7b5ada9: 2023-09-23 15:02:52,937 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bc6b7b17baa9be743ad9a0643b1be1ef: 2023-09-23 15:02:52,937 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-23 15:02:52,937 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-23 15:02:52,937 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:02:52,937 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:02:52,937 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/cf/d47a771bbee94b55a6d00f4c71996337] hfiles 2023-09-23 15:02:52,937 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/cf/e3e21ea50c2d45399bd1ef187f3b498a] hfiles 2023-09-23 15:02:52,937 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/cf/e3e21ea50c2d45399bd1ef187f3b498a for snapshot=snaptb0-testConsecutiveExports 2023-09-23 15:02:52,937 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/cf/d47a771bbee94b55a6d00f4c71996337 for snapshot=snaptb0-testConsecutiveExports 2023-09-23 15:02:52,942 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:52,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 15:02:52,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:02:52,944 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 15:02:52,945 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. completed. 2023-09-23 15:02:52,946 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. completed. 2023-09-23 15:02:52,946 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:02:52,946 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:02:52,946 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:02:52,946 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:02:52,946 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:02:52,946 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,946 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:02:52,946 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-23 15:02:52,946 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:02:52,946 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,946 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-23 15:02:52,946 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:02:52,948 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 15:02:52,948 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,948 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:52,948 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 15:02:52,948 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-23 15:02:52,948 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,948 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:52,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,950 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-23 15:02:52,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:52,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:52,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:52,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:52,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 15:02:52,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:52,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 15:02:52,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40421,1695481329420': 2023-09-23 15:02:52,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-23 15:02:52,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:52,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:52,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:52,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:52,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 15:02:52,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:52,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 15:02:52,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39755,1695481329466': 2023-09-23 15:02:52,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-23 15:02:52,958 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-23 15:02:52,958 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:02:52,958 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:02:52,958 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-23 15:02:52,958 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:02:52,960 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,960 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,960 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,960 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:52,960 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,960 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:52,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,960 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:52,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:52,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:52,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,961 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:52,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:52,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:02:52,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:02:52,961 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:52,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:52,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:02:52,961 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,963 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 15:02:52,964 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:02:52,964 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 15:02:52,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:02:52,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 15:02:52,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:52,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:52,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:52,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:52,972 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-23 15:02:52,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:02:52,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:52,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:52,972 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-23 15:02:52,972 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:02:52,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:52,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:02:52,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:52,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:02:52,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-23 15:02:52,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports because node does not exist (not an error) 2023-09-23 15:02:52,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 15:02:52,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:52,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:52,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:02:52,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:52,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:52,975 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,975 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:02:52,975 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,975 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:02:52,975 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:02:52,975 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,975 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 15:02:52,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:02:52,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:02:52,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230923adfcc100c6004760ab839c72d96a9094, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309237189726dc991401e88af6dd8fc41936c] mob files 2023-09-23 15:02:52,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230923adfcc100c6004760ab839c72d96a9094 2023-09-23 15:02:52,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309237189726dc991401e88af6dd8fc41936c 2023-09-23 15:02:52,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-23 15:02:52,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 15:02:53,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 15:02:53,010 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-23 15:02:53,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 15:02:53,011 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 15:02:53,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695481372841Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695481372987 (+146 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695481372987Loading Region manifests for snaptb0-testConsecutiveExports at 1695481372987Writing data manifest for snaptb0-testConsecutiveExports at 1695481372991 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695481373002 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695481373010 (+8 ms) 2023-09-23 15:02:53,015 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 15:02:53,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 173 msec 2023-09-23 15:02:53,144 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:02:53,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 15:02:53,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:02:53,146 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146 2023-09-23 15:02:53,146 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146, srcFsUri=hdfs://localhost:35975, srcDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:02:53,170 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:02:53,170 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2327540b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 15:02:53,170 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8, snapshotDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-23 15:02:53,179 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 15:02:53,192 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:53,193 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:53,193 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:53,194 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:54,084 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-6862888721629386006.jar 2023-09-23 15:02:54,084 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:54,084 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:54,151 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-1714873178503020818.jar 2023-09-23 15:02:54,152 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:54,152 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:54,152 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:54,153 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:54,153 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:54,154 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 15:02:54,154 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 15:02:54,154 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 15:02:54,155 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 15:02:54,155 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 15:02:54,155 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 15:02:54,156 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 15:02:54,156 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 15:02:54,157 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 15:02:54,157 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 15:02:54,158 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 15:02:54,158 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:02:54,159 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:02:54,159 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:02:54,160 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:02:54,160 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:02:54,160 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:02:54,161 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:02:54,554 WARN [Listener at jenkins-hbase4.apache.org/46353] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 15:02:54,556 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-23 15:02:54,558 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-23 15:02:55,974 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:02:55,974 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:02:55,977 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0002_000001 (auth:SIMPLE) 2023-09-23 15:02:56,777 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0003_000001 (auth:SIMPLE) 2023-09-23 15:02:57,074 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 15:03:00,597 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0003_000001 (auth:SIMPLE) 2023-09-23 15:03:02,831 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0003_000001 (auth:SIMPLE) 2023-09-23 15:03:05,286 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0003_000001 (auth:SIMPLE) 2023-09-23 15:03:06,822 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 15:03:06,822 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 15:03:06,826 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-23 15:03:06,827 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 15:03:06,827 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 15:03:06,828 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1038652771_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 15:03:06,830 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 15:03:06,831 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 15:03:06,831 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@42f2ce87 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 15:03:06,831 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 15:03:06,831 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 15:03:06,832 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146, srcFsUri=hdfs://localhost:35975, srcDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:03:06,854 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:03:06,854 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@13057b75, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 15:03:06,854 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8, snapshotDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-23 15:03:06,869 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 15:03:06,880 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:06,881 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:06,881 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:06,882 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:07,757 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-7129371890064068068.jar 2023-09-23 15:03:07,757 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:07,758 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:07,826 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-7619441520982794843.jar 2023-09-23 15:03:07,826 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:07,827 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:07,827 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:07,827 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:07,828 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:07,828 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:07,829 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 15:03:07,829 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 15:03:07,829 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 15:03:07,830 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 15:03:07,830 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 15:03:07,831 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 15:03:07,831 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 15:03:07,831 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 15:03:07,831 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 15:03:07,832 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 15:03:07,833 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:07,833 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:07,834 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:03:07,834 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:07,834 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:07,835 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:03:07,835 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:03:08,239 WARN [Listener at jenkins-hbase4.apache.org/46353] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 15:03:08,242 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-23 15:03:08,245 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-23 15:03:11,457 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:03:11,458 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:03:11,460 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0003_000001 (auth:SIMPLE) 2023-09-23 15:03:11,987 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0004_000001 (auth:SIMPLE) 2023-09-23 15:03:15,809 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0004_000001 (auth:SIMPLE) 2023-09-23 15:03:18,021 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0004_000001 (auth:SIMPLE) 2023-09-23 15:03:20,360 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0004_000001 (auth:SIMPLE) 2023-09-23 15:03:21,415 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 15:03:21,416 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 15:03:21,419 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-23 15:03:21,419 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 15:03:21,419 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 15:03:21,419 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1038652771_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 15:03:21,423 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 15:03:21,424 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 15:03:21,424 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@42f2ce87 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 15:03:21,424 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 15:03:21,424 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/local-export-1695481373146/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 15:03:21,436 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-23 15:03:21,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-23 15:03:21,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-23 15:03:21,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-23 15:03:21,442 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481401442"}]},"ts":"1695481401442"} 2023-09-23 15:03:21,443 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-23 15:03:21,446 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-23 15:03:21,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ebca342aa9c1feaebbf4ea72e7b5ada9, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bc6b7b17baa9be743ad9a0643b1be1ef, UNASSIGN}] 2023-09-23 15:03:21,450 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ebca342aa9c1feaebbf4ea72e7b5ada9, UNASSIGN 2023-09-23 15:03:21,450 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bc6b7b17baa9be743ad9a0643b1be1ef, UNASSIGN 2023-09-23 15:03:21,450 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ebca342aa9c1feaebbf4ea72e7b5ada9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:21,450 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=bc6b7b17baa9be743ad9a0643b1be1ef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:21,451 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695481401450"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481401450"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481401450"}]},"ts":"1695481401450"} 2023-09-23 15:03:21,451 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695481401450"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481401450"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481401450"}]},"ts":"1695481401450"} 2023-09-23 15:03:21,452 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure ebca342aa9c1feaebbf4ea72e7b5ada9, server=jenkins-hbase4.apache.org,39755,1695481329466}] 2023-09-23 15:03:21,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure bc6b7b17baa9be743ad9a0643b1be1ef, server=jenkins-hbase4.apache.org,40421,1695481329420}] 2023-09-23 15:03:21,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-23 15:03:21,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:03:21,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ebca342aa9c1feaebbf4ea72e7b5ada9, disabling compactions & flushes 2023-09-23 15:03:21,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:03:21,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:03:21,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. after waiting 0 ms 2023-09-23 15:03:21,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:03:21,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:03:21,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bc6b7b17baa9be743ad9a0643b1be1ef, disabling compactions & flushes 2023-09-23 15:03:21,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:03:21,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:03:21,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. after waiting 0 ms 2023-09-23 15:03:21,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:03:21,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:03:21,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:03:21,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:03:21,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9. 2023-09-23 15:03:21,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ebca342aa9c1feaebbf4ea72e7b5ada9: 2023-09-23 15:03:21,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:03:21,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef. 2023-09-23 15:03:21,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bc6b7b17baa9be743ad9a0643b1be1ef: 2023-09-23 15:03:21,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:03:21,629 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ebca342aa9c1feaebbf4ea72e7b5ada9, regionState=CLOSED 2023-09-23 15:03:21,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:03:21,629 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695481401629"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481401629"}]},"ts":"1695481401629"} 2023-09-23 15:03:21,629 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=bc6b7b17baa9be743ad9a0643b1be1ef, regionState=CLOSED 2023-09-23 15:03:21,630 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695481401629"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481401629"}]},"ts":"1695481401629"} 2023-09-23 15:03:21,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-23 15:03:21,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure ebca342aa9c1feaebbf4ea72e7b5ada9, server=jenkins-hbase4.apache.org,39755,1695481329466 in 179 msec 2023-09-23 15:03:21,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-23 15:03:21,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure bc6b7b17baa9be743ad9a0643b1be1ef, server=jenkins-hbase4.apache.org,40421,1695481329420 in 178 msec 2023-09-23 15:03:21,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ebca342aa9c1feaebbf4ea72e7b5ada9, UNASSIGN in 185 msec 2023-09-23 15:03:21,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-23 15:03:21,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bc6b7b17baa9be743ad9a0643b1be1ef, UNASSIGN in 186 msec 2023-09-23 15:03:21,636 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481401636"}]},"ts":"1695481401636"} 2023-09-23 15:03:21,637 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-23 15:03:21,639 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-23 15:03:21,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 202 msec 2023-09-23 15:03:21,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-23 15:03:21,744 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-23 15:03:21,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-23 15:03:21,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 15:03:21,748 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 15:03:21,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-23 15:03:21,749 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 15:03:21,752 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-23 15:03:21,755 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 15:03:21,755 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 15:03:21,755 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 15:03:21,755 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 15:03:21,755 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 15:03:21,755 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 15:03:21,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 15:03:21,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 15:03:21,755 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:03:21,756 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:03:21,757 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 15:03:21,757 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 15:03:21,758 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 15:03:21,757 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:21,758 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:21,758 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:21,758 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 15:03:21,758 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:21,758 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/recovered.edits] 2023-09-23 15:03:21,758 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/recovered.edits] 2023-09-23 15:03:21,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-23 15:03:21,763 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/cf/e3e21ea50c2d45399bd1ef187f3b498a to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/cf/e3e21ea50c2d45399bd1ef187f3b498a 2023-09-23 15:03:21,763 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/cf/d47a771bbee94b55a6d00f4c71996337 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/cf/d47a771bbee94b55a6d00f4c71996337 2023-09-23 15:03:21,766 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/recovered.edits/9.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef/recovered.edits/9.seqid 2023-09-23 15:03:21,767 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/recovered.edits/9.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9/recovered.edits/9.seqid 2023-09-23 15:03:21,767 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/bc6b7b17baa9be743ad9a0643b1be1ef 2023-09-23 15:03:21,767 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testConsecutiveExports/ebca342aa9c1feaebbf4ea72e7b5ada9 2023-09-23 15:03:21,767 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-23 15:03:21,768 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-23 15:03:21,768 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-23 15:03:21,771 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230923adfcc100c6004760ab839c72d96a9094 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230923adfcc100c6004760ab839c72d96a9094 2023-09-23 15:03:21,773 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309237189726dc991401e88af6dd8fc41936c to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309237189726dc991401e88af6dd8fc41936c 2023-09-23 15:03:21,773 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-23 15:03:21,776 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 15:03:21,778 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-23 15:03:21,780 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-23 15:03:21,781 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 15:03:21,781 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-23 15:03:21,782 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481401781"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:21,782 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481401781"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:21,788 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 15:03:21,788 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ebca342aa9c1feaebbf4ea72e7b5ada9, NAME => 'testtb-testConsecutiveExports,,1695481371797.ebca342aa9c1feaebbf4ea72e7b5ada9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bc6b7b17baa9be743ad9a0643b1be1ef, NAME => 'testtb-testConsecutiveExports,1,1695481371797.bc6b7b17baa9be743ad9a0643b1be1ef.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 15:03:21,788 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-23 15:03:21,788 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695481401788"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:21,790 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-23 15:03:21,792 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 15:03:21,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 47 msec 2023-09-23 15:03:21,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-23 15:03:21,860 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-23 15:03:21,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-23 15:03:21,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-23 15:03:21,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-23 15:03:21,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-23 15:03:21,898 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 762), OpenFileDescriptor=899 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=190 (was 190), ProcessCount=168 (was 168), AvailableMemoryMB=1282 (was 1382) 2023-09-23 15:03:21,898 WARN [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-23 15:03:21,919 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=190, ProcessCount=168, AvailableMemoryMB=1280 2023-09-23 15:03:21,920 WARN [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-23 15:03:21,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 15:03:21,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:21,925 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 15:03:21,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-23 15:03:21,926 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 15:03:21,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 15:03:21,929 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:21,929 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:21,930 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08 empty. 2023-09-23 15:03:21,930 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744 empty. 2023-09-23 15:03:21,930 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:21,930 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:21,930 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-23 15:03:21,944 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-23 15:03:21,946 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9e0e3ea3fef365f5406b25ca90c74e08, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:03:21,946 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 186c0c91e45cebbd62decbce5f7b6744, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:03:21,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:21,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:21,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 9e0e3ea3fef365f5406b25ca90c74e08, disabling compactions & flushes 2023-09-23 15:03:21,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 186c0c91e45cebbd62decbce5f7b6744, disabling compactions & flushes 2023-09-23 15:03:21,961 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:21,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:21,961 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:21,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. after waiting 0 ms 2023-09-23 15:03:21,962 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:21,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:21,962 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:21,962 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. after waiting 0 ms 2023-09-23 15:03:21,962 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:21,962 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 9e0e3ea3fef365f5406b25ca90c74e08: 2023-09-23 15:03:21,962 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:21,962 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 186c0c91e45cebbd62decbce5f7b6744: 2023-09-23 15:03:21,964 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 15:03:21,966 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695481401966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481401966"}]},"ts":"1695481401966"} 2023-09-23 15:03:21,966 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695481401966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481401966"}]},"ts":"1695481401966"} 2023-09-23 15:03:21,968 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 15:03:21,969 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 15:03:21,970 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481401970"}]},"ts":"1695481401970"} 2023-09-23 15:03:21,971 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-23 15:03:21,974 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 15:03:21,976 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 15:03:21,976 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 15:03:21,976 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 15:03:21,976 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 15:03:21,976 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e0e3ea3fef365f5406b25ca90c74e08, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=186c0c91e45cebbd62decbce5f7b6744, ASSIGN}] 2023-09-23 15:03:21,980 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e0e3ea3fef365f5406b25ca90c74e08, ASSIGN 2023-09-23 15:03:21,980 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=186c0c91e45cebbd62decbce5f7b6744, ASSIGN 2023-09-23 15:03:21,981 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e0e3ea3fef365f5406b25ca90c74e08, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39755,1695481329466; forceNewPlan=false, retain=false 2023-09-23 15:03:21,981 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=186c0c91e45cebbd62decbce5f7b6744, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40421,1695481329420; forceNewPlan=false, retain=false 2023-09-23 15:03:22,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 15:03:22,131 INFO [jenkins-hbase4:40555] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 15:03:22,134 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9e0e3ea3fef365f5406b25ca90c74e08, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,134 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=186c0c91e45cebbd62decbce5f7b6744, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,134 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695481402134"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481402134"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481402134"}]},"ts":"1695481402134"} 2023-09-23 15:03:22,134 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695481402134"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481402134"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481402134"}]},"ts":"1695481402134"} 2023-09-23 15:03:22,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 186c0c91e45cebbd62decbce5f7b6744, server=jenkins-hbase4.apache.org,40421,1695481329420}] 2023-09-23 15:03:22,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 9e0e3ea3fef365f5406b25ca90c74e08, server=jenkins-hbase4.apache.org,39755,1695481329466}] 2023-09-23 15:03:22,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 15:03:22,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:22,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:22,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 186c0c91e45cebbd62decbce5f7b6744, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 15:03:22,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9e0e3ea3fef365f5406b25ca90c74e08, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 15:03:22,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. service=AccessControlService 2023-09-23 15:03:22,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. service=AccessControlService 2023-09-23 15:03:22,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:03:22,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:03:22,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:22,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:22,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:22,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:22,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:22,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:22,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:22,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:22,294 INFO [StoreOpener-9e0e3ea3fef365f5406b25ca90c74e08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:22,294 INFO [StoreOpener-186c0c91e45cebbd62decbce5f7b6744-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:22,296 DEBUG [StoreOpener-9e0e3ea3fef365f5406b25ca90c74e08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/cf 2023-09-23 15:03:22,296 DEBUG [StoreOpener-186c0c91e45cebbd62decbce5f7b6744-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/cf 2023-09-23 15:03:22,296 DEBUG [StoreOpener-186c0c91e45cebbd62decbce5f7b6744-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/cf 2023-09-23 15:03:22,296 DEBUG [StoreOpener-9e0e3ea3fef365f5406b25ca90c74e08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/cf 2023-09-23 15:03:22,297 INFO [StoreOpener-9e0e3ea3fef365f5406b25ca90c74e08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e0e3ea3fef365f5406b25ca90c74e08 columnFamilyName cf 2023-09-23 15:03:22,297 INFO [StoreOpener-186c0c91e45cebbd62decbce5f7b6744-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 186c0c91e45cebbd62decbce5f7b6744 columnFamilyName cf 2023-09-23 15:03:22,299 INFO [StoreOpener-186c0c91e45cebbd62decbce5f7b6744-1] regionserver.HStore(310): Store=186c0c91e45cebbd62decbce5f7b6744/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:03:22,299 INFO [StoreOpener-9e0e3ea3fef365f5406b25ca90c74e08-1] regionserver.HStore(310): Store=9e0e3ea3fef365f5406b25ca90c74e08/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:03:22,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:22,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:22,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:22,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:22,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:22,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:22,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:03:22,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:03:22,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 186c0c91e45cebbd62decbce5f7b6744; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60837602, jitterRate=-0.09344908595085144}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:03:22,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 186c0c91e45cebbd62decbce5f7b6744: 2023-09-23 15:03:22,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9e0e3ea3fef365f5406b25ca90c74e08; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62954280, jitterRate=-0.06190812587738037}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:03:22,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9e0e3ea3fef365f5406b25ca90c74e08: 2023-09-23 15:03:22,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744., pid=60, masterSystemTime=1695481402288 2023-09-23 15:03:22,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08., pid=61, masterSystemTime=1695481402289 2023-09-23 15:03:22,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:22,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:22,310 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=186c0c91e45cebbd62decbce5f7b6744, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:22,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:22,310 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695481402310"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481402310"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481402310"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481402310"}]},"ts":"1695481402310"} 2023-09-23 15:03:22,311 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9e0e3ea3fef365f5406b25ca90c74e08, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,311 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695481402311"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481402311"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481402311"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481402311"}]},"ts":"1695481402311"} 2023-09-23 15:03:22,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-23 15:03:22,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 186c0c91e45cebbd62decbce5f7b6744, server=jenkins-hbase4.apache.org,40421,1695481329420 in 176 msec 2023-09-23 15:03:22,315 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-23 15:03:22,315 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 9e0e3ea3fef365f5406b25ca90c74e08, server=jenkins-hbase4.apache.org,39755,1695481329466 in 176 msec 2023-09-23 15:03:22,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=186c0c91e45cebbd62decbce5f7b6744, ASSIGN in 338 msec 2023-09-23 15:03:22,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-23 15:03:22,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e0e3ea3fef365f5406b25ca90c74e08, ASSIGN in 339 msec 2023-09-23 15:03:22,318 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 15:03:22,318 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481402318"}]},"ts":"1695481402318"} 2023-09-23 15:03:22,319 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-23 15:03:22,323 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 15:03:22,323 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-23 15:03:22,326 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-23 15:03:22,327 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:22,327 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:22,327 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:22,327 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:22,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:22,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:22,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:22,329 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:22,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 407 msec 2023-09-23 15:03:22,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 15:03:22,531 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-23 15:03:22,534 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,534 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:22,536 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:03:22,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 15:03:22,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481402548 (current time:1695481402548). 2023-09-23 15:03:22,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:03:22,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x4b20fa83 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:22,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d293f91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:22,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:22,559 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:22,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b20fa83 to 127.0.0.1:55260 2023-09-23 15:03:22,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:22,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x0a4929c6 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:22,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46f12eee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:22,568 DEBUG [hconnection-0x62005416-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:22,571 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:22,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a4929c6 to 127.0.0.1:55260 2023-09-23 15:03:22,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:22,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-23 15:03:22,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:03:22,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 15:03:22,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 15:03:22,580 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 15:03:22,580 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695482002580 2023-09-23 15:03:22,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 15:03:22,580 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,582 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:03:22,582 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:03:22,583 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 15:03:22,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 15:03:22,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-23 15:03:22,585 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 15:03:22,585 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695482002585 2023-09-23 15:03:22,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,597 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-23 15:03:22,597 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:22,598 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-23 15:03:22,598 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-23 15:03:22,599 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,599 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,600 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:22,600 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:22,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:22,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:22,600 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:22,600 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:22,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:22,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:22,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:22,601 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,601 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,602 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,602 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:03:22,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-23 15:03:22,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-23 15:03:22,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-23 15:03:22,602 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 15:03:22,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,602 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 15:03:22,602 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,602 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 15:03:22,602 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,603 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 15:03:22,603 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 15:03:22,603 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:22,603 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:22,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,604 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 15:03:22,604 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 15:03:22,604 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:22,604 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 15:03:22,605 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 15:03:22,605 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 15:03:22,605 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 15:03:22,605 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 15:03:22,604 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 15:03:22,605 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 15:03:22,606 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 15:03:22,612 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,612 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,612 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,612 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:22,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,613 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:22,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:22,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:22,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 15:03:22,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@599d38de[Count = 1] remaining members to acquire global barrier 2023-09-23 15:03:22,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:22,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:22,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:22,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:22,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:22,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 15:03:22,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@599d38de[Count = 0] remaining members to acquire global barrier 2023-09-23 15:03:22,617 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-23 15:03:22,617 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,618 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,618 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,618 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,619 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 15:03:22,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,619 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:22,619 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 15:03:22,619 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 15:03:22,619 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,619 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 15:03:22,619 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:22,619 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:03:22,619 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:22,619 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:22,619 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:22,619 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. started... 2023-09-23 15:03:22,619 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. started... 2023-09-23 15:03:22,619 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,619 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:03:22,619 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:22,621 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e0e3ea3fef365f5406b25ca90c74e08: 2023-09-23 15:03:22,621 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 186c0c91e45cebbd62decbce5f7b6744: 2023-09-23 15:03:22,621 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,621 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,621 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:22,621 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:22,621 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 15:03:22,621 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 15:03:22,628 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 15:03:22,628 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:22,628 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 15:03:22,632 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. completed. 2023-09-23 15:03:22,632 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:22,632 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:22,632 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. completed. 2023-09-23 15:03:22,632 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:22,632 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,632 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:22,632 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 15:03:22,633 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:03:22,633 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:22,633 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:22,633 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,633 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 15:03:22,633 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:03:22,634 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 15:03:22,634 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:22,634 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,634 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 15:03:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:22,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:22,635 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,635 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 15:03:22,635 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:22,635 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 15:03:22,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:22,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:22,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:22,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39755,1695481329466': 2023-09-23 15:03:22,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-23 15:03:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:22,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:22,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40421,1695481329420': 2023-09-23 15:03:22,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-23 15:03:22,643 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-23 15:03:22,643 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:03:22,643 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:03:22,643 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,643 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:03:22,645 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,645 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,645 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,645 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:22,645 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,645 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,645 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,646 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:22,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:22,646 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,647 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,649 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,649 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,650 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,654 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,654 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:22,654 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:22,654 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:22,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:22,654 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:22,654 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:22,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:22,654 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:22,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:22,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:22,654 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:22,654 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:22,654 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,656 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:22,655 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:22,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:22,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:22,661 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:22,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:22,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 15:03:22,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:22,661 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,661 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,661 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,661 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,661 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,661 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,661 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 15:03:22,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,682 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:22,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 15:03:22,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:03:22,683 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 15:03:22,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,701 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-23 15:03:22,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,701 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695481402581Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695481402674 (+93 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695481402674Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695481402674Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695481402679 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695481402694 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695481402701 (+7 ms) 2023-09-23 15:03:22,704 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 15:03:22,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 123 msec 2023-09-23 15:03:22,883 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:22,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 15:03:22,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:03:22,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39755] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 15:03:22,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40421] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 15:03:22,892 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,892 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:22,892 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:03:22,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 15:03:22,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481402903 (current time:1695481402903). 2023-09-23 15:03:22,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:03:22,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x465d60db to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:22,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b9709eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:22,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:22,914 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:22,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x465d60db to 127.0.0.1:55260 2023-09-23 15:03:22,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:22,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x6a737032 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:22,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47858e1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:22,923 DEBUG [hconnection-0x140e0f55-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:22,925 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:22,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a737032 to 127.0.0.1:55260 2023-09-23 15:03:22,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:22,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-23 15:03:22,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:03:22,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 15:03:22,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 15:03:22,934 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 15:03:22,935 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695482002935 2023-09-23 15:03:22,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 15:03:22,935 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,936 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:03:22,936 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:03:22,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 15:03:22,937 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 15:03:22,938 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-23 15:03:22,939 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 15:03:22,940 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695482002940 2023-09-23 15:03:22,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,948 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-23 15:03:22,948 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:22,949 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-23 15:03:22,950 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-23 15:03:22,950 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,950 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,951 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:22,951 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:22,951 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:22,951 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:22,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:22,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:22,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:22,952 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:22,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:22,952 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,952 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,952 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:03:22,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-23 15:03:22,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-23 15:03:22,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-23 15:03:22,953 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 15:03:22,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,953 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 15:03:22,953 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 15:03:22,953 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 15:03:22,953 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:22,954 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,955 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 15:03:22,955 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 15:03:22,955 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:22,955 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 15:03:22,956 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 15:03:22,956 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 15:03:22,956 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 15:03:22,956 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 15:03:22,955 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:22,956 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 15:03:22,957 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 15:03:22,957 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 15:03:22,957 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 15:03:22,958 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,958 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:22,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:22,959 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,959 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:22,959 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,959 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,959 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:22,959 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,959 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:22,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:22,960 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,960 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:22,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:22,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 15:03:22,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@600177cf[Count = 1] remaining members to acquire global barrier 2023-09-23 15:03:22,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:22,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:22,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:22,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:22,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:22,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:22,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 15:03:22,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@600177cf[Count = 0] remaining members to acquire global barrier 2023-09-23 15:03:22,963 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-23 15:03:22,963 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,965 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,965 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,965 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,966 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 15:03:22,966 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:22,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:22,966 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 15:03:22,966 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 15:03:22,966 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 15:03:22,966 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:22,966 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:22,966 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. started... 2023-09-23 15:03:22,966 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:22,966 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:22,966 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:22,966 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:22,966 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:22,966 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:03:22,966 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:03:22,966 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 186c0c91e45cebbd62decbce5f7b6744 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-23 15:03:22,966 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. started... 2023-09-23 15:03:22,967 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9e0e3ea3fef365f5406b25ca90c74e08 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-23 15:03:22,968 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 15:03:22,968 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:22,968 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 15:03:22,983 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092398b2ff4489bd4a328ff486dadd999d56 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092398b2ff4489bd4a328ff486dadd999d56 2023-09-23 15:03:22,984 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230923e0cf1c5fbc604c42ace6c165fcd41363 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923e0cf1c5fbc604c42ace6c165fcd41363 2023-09-23 15:03:22,994 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/.tmp/cf/fd6b7b43c0a64ea1a1acab408325a5fe 2023-09-23 15:03:22,994 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/.tmp/cf/665ab962b0cc48b3998d075581d15726 2023-09-23 15:03:23,000 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/.tmp/cf/665ab962b0cc48b3998d075581d15726 as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/cf/665ab962b0cc48b3998d075581d15726 2023-09-23 15:03:23,000 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/.tmp/cf/fd6b7b43c0a64ea1a1acab408325a5fe as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/cf/fd6b7b43c0a64ea1a1acab408325a5fe 2023-09-23 15:03:23,004 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/cf/665ab962b0cc48b3998d075581d15726, entries=2, sequenceid=6, filesize=5.3 K 2023-09-23 15:03:23,005 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 9e0e3ea3fef365f5406b25ca90c74e08 in 38ms, sequenceid=6, compaction requested=false 2023-09-23 15:03:23,006 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-23 15:03:23,006 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e0e3ea3fef365f5406b25ca90c74e08: 2023-09-23 15:03:23,006 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,006 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:23,006 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/cf/665ab962b0cc48b3998d075581d15726] hfiles 2023-09-23 15:03:23,006 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/cf/665ab962b0cc48b3998d075581d15726 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,007 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/cf/fd6b7b43c0a64ea1a1acab408325a5fe, entries=48, sequenceid=6, filesize=13.7 K 2023-09-23 15:03:23,007 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 186c0c91e45cebbd62decbce5f7b6744 in 41ms, sequenceid=6, compaction requested=false 2023-09-23 15:03:23,009 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 186c0c91e45cebbd62decbce5f7b6744: 2023-09-23 15:03:23,009 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,009 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:23,010 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/cf/fd6b7b43c0a64ea1a1acab408325a5fe] hfiles 2023-09-23 15:03:23,010 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/cf/fd6b7b43c0a64ea1a1acab408325a5fe for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,015 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. completed. 2023-09-23 15:03:23,015 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:23,015 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:23,015 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:23,015 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,015 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 15:03:23,015 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:03:23,018 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,018 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. completed. 2023-09-23 15:03:23,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:23,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:23,018 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:23,018 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 15:03:23,019 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:23,019 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:23,019 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:23,019 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,019 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 15:03:23,020 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 15:03:23,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:23,020 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:03:23,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:23,022 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,022 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 15:03:23,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,022 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:23,022 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 15:03:23,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:23,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39755,1695481329466': 2023-09-23 15:03:23,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-23 15:03:23,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:23,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:23,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:23,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:23,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:23,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40421,1695481329420': 2023-09-23 15:03:23,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-23 15:03:23,029 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-23 15:03:23,029 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:03:23,029 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:03:23,029 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,029 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:03:23,035 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,035 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,035 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:23,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:23,035 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,035 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:23,035 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:23,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,036 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:23,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,035 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:23,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:23,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:23,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:23,036 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:23,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:23,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:23,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,036 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,036 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:23,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:23,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 15:03:23,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:03:23,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,038 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 15:03:23,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,038 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:23,039 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,039 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:23,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:23,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:23,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:23,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:23,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:23,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,042 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:23,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:23,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:23,044 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:23,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:23,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:23,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 15:03:23,044 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:23,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:23,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:23,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:23,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:23,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:23,044 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,045 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,045 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:23,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:23,045 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,045 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923e0cf1c5fbc604c42ace6c165fcd41363, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092398b2ff4489bd4a328ff486dadd999d56] mob files 2023-09-23 15:03:23,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923e0cf1c5fbc604c42ace6c165fcd41363 2023-09-23 15:03:23,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092398b2ff4489bd4a328ff486dadd999d56 2023-09-23 15:03:23,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-23 15:03:23,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,078 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:23,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695481402935Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695481403053 (+118 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695481403053Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695481403054 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695481403057 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695481403069 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695481403078 (+9 ms) 2023-09-23 15:03:23,081 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 15:03:23,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 145 msec 2023-09-23 15:03:23,238 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:23,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 15:03:23,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:03:23,270 DEBUG [Listener at jenkins-hbase4.apache.org/46353] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 15:03:23,275 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 15:03:23,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39421] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-23 15:03:23,277 DEBUG [Listener at jenkins-hbase4.apache.org/46353] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 15:03:23,281 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 15:03:23,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39755] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-23 15:03:23,282 DEBUG [Listener at jenkins-hbase4.apache.org/46353] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 15:03:23,287 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 15:03:23,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40421] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-23 15:03:23,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-23 15:03:23,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:23,292 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 15:03:23,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-23 15:03:23,293 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 15:03:23,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 15:03:23,295 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:23,295 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:23,296 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e empty. 2023-09-23 15:03:23,296 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224 empty. 2023-09-23 15:03:23,296 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:23,296 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:23,296 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-23 15:03:23,306 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-23 15:03:23,307 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6a04f0fd1cbe385d2250e6aadb39a34e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:03:23,310 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2261d4cb6faae3753945d103dd897224, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:03:23,316 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:23,317 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 6a04f0fd1cbe385d2250e6aadb39a34e, disabling compactions & flushes 2023-09-23 15:03:23,317 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. 2023-09-23 15:03:23,317 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. 2023-09-23 15:03:23,317 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. after waiting 0 ms 2023-09-23 15:03:23,317 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. 2023-09-23 15:03:23,317 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. 2023-09-23 15:03:23,317 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 6a04f0fd1cbe385d2250e6aadb39a34e: 2023-09-23 15:03:23,317 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:23,317 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 2261d4cb6faae3753945d103dd897224, disabling compactions & flushes 2023-09-23 15:03:23,317 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. 2023-09-23 15:03:23,317 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. 2023-09-23 15:03:23,317 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. after waiting 0 ms 2023-09-23 15:03:23,317 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. 2023-09-23 15:03:23,317 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. 2023-09-23 15:03:23,318 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 2261d4cb6faae3753945d103dd897224: 2023-09-23 15:03:23,320 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 15:03:23,320 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695481403320"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481403320"}]},"ts":"1695481403320"} 2023-09-23 15:03:23,321 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695481403320"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481403320"}]},"ts":"1695481403320"} 2023-09-23 15:03:23,323 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 15:03:23,323 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 15:03:23,323 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481403323"}]},"ts":"1695481403323"} 2023-09-23 15:03:23,325 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-23 15:03:23,327 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 15:03:23,329 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 15:03:23,329 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 15:03:23,329 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 15:03:23,329 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 15:03:23,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6a04f0fd1cbe385d2250e6aadb39a34e, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2261d4cb6faae3753945d103dd897224, ASSIGN}] 2023-09-23 15:03:23,332 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2261d4cb6faae3753945d103dd897224, ASSIGN 2023-09-23 15:03:23,332 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6a04f0fd1cbe385d2250e6aadb39a34e, ASSIGN 2023-09-23 15:03:23,333 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2261d4cb6faae3753945d103dd897224, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39755,1695481329466; forceNewPlan=false, retain=false 2023-09-23 15:03:23,333 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6a04f0fd1cbe385d2250e6aadb39a34e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39421,1695481329509; forceNewPlan=false, retain=false 2023-09-23 15:03:23,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 15:03:23,483 INFO [jenkins-hbase4:40555] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 15:03:23,487 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6a04f0fd1cbe385d2250e6aadb39a34e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,487 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=2261d4cb6faae3753945d103dd897224, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,487 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695481403486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481403486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481403486"}]},"ts":"1695481403486"} 2023-09-23 15:03:23,487 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695481403486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481403486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481403486"}]},"ts":"1695481403486"} 2023-09-23 15:03:23,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 6a04f0fd1cbe385d2250e6aadb39a34e, server=jenkins-hbase4.apache.org,39421,1695481329509}] 2023-09-23 15:03:23,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 2261d4cb6faae3753945d103dd897224, server=jenkins-hbase4.apache.org,39755,1695481329466}] 2023-09-23 15:03:23,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 15:03:23,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. 2023-09-23 15:03:23,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. 2023-09-23 15:03:23,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2261d4cb6faae3753945d103dd897224, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224.', STARTKEY => '2', ENDKEY => ''} 2023-09-23 15:03:23,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6a04f0fd1cbe385d2250e6aadb39a34e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e.', STARTKEY => '', ENDKEY => '2'} 2023-09-23 15:03:23,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. service=AccessControlService 2023-09-23 15:03:23,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. service=AccessControlService 2023-09-23 15:03:23,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:03:23,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:23,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:23,650 INFO [StoreOpener-6a04f0fd1cbe385d2250e6aadb39a34e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:23,650 INFO [StoreOpener-2261d4cb6faae3753945d103dd897224-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:23,652 DEBUG [StoreOpener-6a04f0fd1cbe385d2250e6aadb39a34e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/cf 2023-09-23 15:03:23,652 DEBUG [StoreOpener-6a04f0fd1cbe385d2250e6aadb39a34e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/cf 2023-09-23 15:03:23,652 DEBUG [StoreOpener-2261d4cb6faae3753945d103dd897224-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/cf 2023-09-23 15:03:23,652 DEBUG [StoreOpener-2261d4cb6faae3753945d103dd897224-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/cf 2023-09-23 15:03:23,652 INFO [StoreOpener-6a04f0fd1cbe385d2250e6aadb39a34e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a04f0fd1cbe385d2250e6aadb39a34e columnFamilyName cf 2023-09-23 15:03:23,652 INFO [StoreOpener-2261d4cb6faae3753945d103dd897224-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2261d4cb6faae3753945d103dd897224 columnFamilyName cf 2023-09-23 15:03:23,653 INFO [StoreOpener-2261d4cb6faae3753945d103dd897224-1] regionserver.HStore(310): Store=2261d4cb6faae3753945d103dd897224/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:03:23,653 INFO [StoreOpener-6a04f0fd1cbe385d2250e6aadb39a34e-1] regionserver.HStore(310): Store=6a04f0fd1cbe385d2250e6aadb39a34e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:03:23,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:23,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:23,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:23,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:23,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:23,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:23,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:03:23,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:03:23,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6a04f0fd1cbe385d2250e6aadb39a34e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73866340, jitterRate=0.10069423913955688}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:03:23,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2261d4cb6faae3753945d103dd897224; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65399795, jitterRate=-0.02546711266040802}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:03:23,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6a04f0fd1cbe385d2250e6aadb39a34e: 2023-09-23 15:03:23,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2261d4cb6faae3753945d103dd897224: 2023-09-23 15:03:23,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224., pid=70, masterSystemTime=1695481403642 2023-09-23 15:03:23,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e., pid=69, masterSystemTime=1695481403640 2023-09-23 15:03:23,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. 2023-09-23 15:03:23,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. 2023-09-23 15:03:23,663 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=2261d4cb6faae3753945d103dd897224, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. 2023-09-23 15:03:23,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. 2023-09-23 15:03:23,663 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695481403663"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481403663"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481403663"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481403663"}]},"ts":"1695481403663"} 2023-09-23 15:03:23,664 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6a04f0fd1cbe385d2250e6aadb39a34e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,664 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695481403664"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481403664"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481403664"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481403664"}]},"ts":"1695481403664"} 2023-09-23 15:03:23,667 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-23 15:03:23,667 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 2261d4cb6faae3753945d103dd897224, server=jenkins-hbase4.apache.org,39755,1695481329466 in 175 msec 2023-09-23 15:03:23,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-23 15:03:23,668 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 6a04f0fd1cbe385d2250e6aadb39a34e, server=jenkins-hbase4.apache.org,39421,1695481329509 in 177 msec 2023-09-23 15:03:23,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2261d4cb6faae3753945d103dd897224, ASSIGN in 338 msec 2023-09-23 15:03:23,669 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-23 15:03:23,669 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6a04f0fd1cbe385d2250e6aadb39a34e, ASSIGN in 339 msec 2023-09-23 15:03:23,670 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 15:03:23,670 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481403670"}]},"ts":"1695481403670"} 2023-09-23 15:03:23,672 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-23 15:03:23,674 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 15:03:23,675 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-23 15:03:23,677 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-23 15:03:23,680 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:23,680 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:23,680 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:23,680 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:23,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:23,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:23,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:23,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:23,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:23,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:23,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:23,682 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:23,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 392 msec 2023-09-23 15:03:23,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 15:03:23,897 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-23 15:03:23,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 6a04f0fd1cbe385d2250e6aadb39a34e, 2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:23,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6a04f0fd1cbe385d2250e6aadb39a34e, 2261d4cb6faae3753945d103dd897224], force=true 2023-09-23 15:03:23,931 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6a04f0fd1cbe385d2250e6aadb39a34e, 2261d4cb6faae3753945d103dd897224], force=true 2023-09-23 15:03:23,931 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6a04f0fd1cbe385d2250e6aadb39a34e, 2261d4cb6faae3753945d103dd897224], force=true 2023-09-23 15:03:23,931 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6a04f0fd1cbe385d2250e6aadb39a34e, 2261d4cb6faae3753945d103dd897224], force=true 2023-09-23 15:03:23,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 15:03:23,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6a04f0fd1cbe385d2250e6aadb39a34e, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2261d4cb6faae3753945d103dd897224, UNASSIGN}] 2023-09-23 15:03:23,955 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6a04f0fd1cbe385d2250e6aadb39a34e, UNASSIGN 2023-09-23 15:03:23,955 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2261d4cb6faae3753945d103dd897224, UNASSIGN 2023-09-23 15:03:23,956 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6a04f0fd1cbe385d2250e6aadb39a34e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:23,956 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=2261d4cb6faae3753945d103dd897224, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:23,956 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695481403956"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481403956"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481403956"}]},"ts":"1695481403956"} 2023-09-23 15:03:23,956 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695481403956"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481403956"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481403956"}]},"ts":"1695481403956"} 2023-09-23 15:03:23,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 6a04f0fd1cbe385d2250e6aadb39a34e, server=jenkins-hbase4.apache.org,39421,1695481329509}] 2023-09-23 15:03:23,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 2261d4cb6faae3753945d103dd897224, server=jenkins-hbase4.apache.org,39755,1695481329466}] 2023-09-23 15:03:24,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 15:03:24,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:24,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:24,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2261d4cb6faae3753945d103dd897224, disabling compactions & flushes 2023-09-23 15:03:24,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6a04f0fd1cbe385d2250e6aadb39a34e, disabling compactions & flushes 2023-09-23 15:03:24,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. 2023-09-23 15:03:24,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. 2023-09-23 15:03:24,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. 2023-09-23 15:03:24,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. 2023-09-23 15:03:24,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. after waiting 0 ms 2023-09-23 15:03:24,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. after waiting 0 ms 2023-09-23 15:03:24,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. 2023-09-23 15:03:24,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. 2023-09-23 15:03:24,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6a04f0fd1cbe385d2250e6aadb39a34e 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-23 15:03:24,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2261d4cb6faae3753945d103dd897224 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-23 15:03:24,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/.tmp/cf/63f777dd191f4a1e945ce191c07b65bf 2023-09-23 15:03:24,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/.tmp/cf/d5997ee4dee94aa8aa12cb630182d78b 2023-09-23 15:03:24,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/.tmp/cf/63f777dd191f4a1e945ce191c07b65bf as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/cf/63f777dd191f4a1e945ce191c07b65bf 2023-09-23 15:03:24,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/.tmp/cf/d5997ee4dee94aa8aa12cb630182d78b as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/cf/d5997ee4dee94aa8aa12cb630182d78b 2023-09-23 15:03:24,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/cf/d5997ee4dee94aa8aa12cb630182d78b, entries=1, sequenceid=5, filesize=4.7 K 2023-09-23 15:03:24,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/cf/63f777dd191f4a1e945ce191c07b65bf, entries=1, sequenceid=5, filesize=4.7 K 2023-09-23 15:03:24,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 6a04f0fd1cbe385d2250e6aadb39a34e in 25ms, sequenceid=5, compaction requested=false 2023-09-23 15:03:24,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-23 15:03:24,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 2261d4cb6faae3753945d103dd897224 in 25ms, sequenceid=5, compaction requested=false 2023-09-23 15:03:24,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-23 15:03:24,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-23 15:03:24,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-23 15:03:24,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:03:24,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:03:24,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e. 2023-09-23 15:03:24,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224. 2023-09-23 15:03:24,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6a04f0fd1cbe385d2250e6aadb39a34e: 2023-09-23 15:03:24,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2261d4cb6faae3753945d103dd897224: 2023-09-23 15:03:24,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:24,151 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=2261d4cb6faae3753945d103dd897224, regionState=CLOSED 2023-09-23 15:03:24,151 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695481404151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481404151"}]},"ts":"1695481404151"} 2023-09-23 15:03:24,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:24,152 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6a04f0fd1cbe385d2250e6aadb39a34e, regionState=CLOSED 2023-09-23 15:03:24,152 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695481404152"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481404152"}]},"ts":"1695481404152"} 2023-09-23 15:03:24,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-23 15:03:24,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 2261d4cb6faae3753945d103dd897224, server=jenkins-hbase4.apache.org,39755,1695481329466 in 195 msec 2023-09-23 15:03:24,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-23 15:03:24,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 6a04f0fd1cbe385d2250e6aadb39a34e, server=jenkins-hbase4.apache.org,39421,1695481329509 in 196 msec 2023-09-23 15:03:24,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2261d4cb6faae3753945d103dd897224, UNASSIGN in 202 msec 2023-09-23 15:03:24,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-23 15:03:24,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6a04f0fd1cbe385d2250e6aadb39a34e, UNASSIGN in 205 msec 2023-09-23 15:03:24,198 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-23 15:03:24,200 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403289.6a04f0fd1cbe385d2250e6aadb39a34e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:24,200 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695481403289.2261d4cb6faae3753945d103dd897224.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:24,200 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:24,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 15:03:24,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99b9fda90b07e7b6186d745b1094747f, ASSIGN}] 2023-09-23 15:03:24,250 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99b9fda90b07e7b6186d745b1094747f, ASSIGN 2023-09-23 15:03:24,250 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99b9fda90b07e7b6186d745b1094747f, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39421,1695481329509; forceNewPlan=false, retain=false 2023-09-23 15:03:24,400 INFO [jenkins-hbase4:40555] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-23 15:03:24,402 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=99b9fda90b07e7b6186d745b1094747f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:24,403 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695481404402"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481404402"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481404402"}]},"ts":"1695481404402"} 2023-09-23 15:03:24,404 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 99b9fda90b07e7b6186d745b1094747f, server=jenkins-hbase4.apache.org,39421,1695481329509}] 2023-09-23 15:03:24,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 15:03:24,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. 2023-09-23 15:03:24,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 99b9fda90b07e7b6186d745b1094747f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f.', STARTKEY => '', ENDKEY => ''} 2023-09-23 15:03:24,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. service=AccessControlService 2023-09-23 15:03:24,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:03:24,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 99b9fda90b07e7b6186d745b1094747f 2023-09-23 15:03:24,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:24,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 99b9fda90b07e7b6186d745b1094747f 2023-09-23 15:03:24,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 99b9fda90b07e7b6186d745b1094747f 2023-09-23 15:03:24,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/.regioninfo 2023-09-23 15:03:24,572 INFO [StoreOpener-99b9fda90b07e7b6186d745b1094747f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 99b9fda90b07e7b6186d745b1094747f 2023-09-23 15:03:24,573 DEBUG [StoreOpener-99b9fda90b07e7b6186d745b1094747f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf 2023-09-23 15:03:24,573 DEBUG [StoreOpener-99b9fda90b07e7b6186d745b1094747f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf 2023-09-23 15:03:24,573 INFO [StoreOpener-99b9fda90b07e7b6186d745b1094747f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99b9fda90b07e7b6186d745b1094747f columnFamilyName cf 2023-09-23 15:03:24,601 DEBUG [StoreOpener-99b9fda90b07e7b6186d745b1094747f-1] regionserver.HStore(539): loaded hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf/63f777dd191f4a1e945ce191c07b65bf.2261d4cb6faae3753945d103dd897224->hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/cf/63f777dd191f4a1e945ce191c07b65bf-top 2023-09-23 15:03:24,607 DEBUG [StoreOpener-99b9fda90b07e7b6186d745b1094747f-1] regionserver.HStore(539): loaded hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf/d5997ee4dee94aa8aa12cb630182d78b.6a04f0fd1cbe385d2250e6aadb39a34e->hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/cf/d5997ee4dee94aa8aa12cb630182d78b-top 2023-09-23 15:03:24,607 INFO [StoreOpener-99b9fda90b07e7b6186d745b1094747f-1] regionserver.HStore(310): Store=99b9fda90b07e7b6186d745b1094747f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:03:24,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f 2023-09-23 15:03:24,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f 2023-09-23 15:03:24,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 99b9fda90b07e7b6186d745b1094747f 2023-09-23 15:03:24,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 99b9fda90b07e7b6186d745b1094747f; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63971214, jitterRate=-0.0467546284198761}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:03:24,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 99b9fda90b07e7b6186d745b1094747f: 2023-09-23 15:03:24,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f., pid=77, masterSystemTime=1695481404556 2023-09-23 15:03:24,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f.,because compaction is disabled. 2023-09-23 15:03:24,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. 2023-09-23 15:03:24,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. 2023-09-23 15:03:24,616 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=99b9fda90b07e7b6186d745b1094747f, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:24,617 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695481404616"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481404616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481404616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481404616"}]},"ts":"1695481404616"} 2023-09-23 15:03:24,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-23 15:03:24,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 99b9fda90b07e7b6186d745b1094747f, server=jenkins-hbase4.apache.org,39421,1695481329509 in 214 msec 2023-09-23 15:03:24,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-23 15:03:24,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99b9fda90b07e7b6186d745b1094747f, ASSIGN in 371 msec 2023-09-23 15:03:24,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6a04f0fd1cbe385d2250e6aadb39a34e, 2261d4cb6faae3753945d103dd897224], force=true in 697 msec 2023-09-23 15:03:25,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 15:03:25,039 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-23 15:03:25,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-23 15:03:25,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481405041 (current time:1695481405041). 2023-09-23 15:03:25,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:03:25,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x2f45c7db to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:25,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66d7f677, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:25,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:25,051 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:25,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f45c7db to 127.0.0.1:55260 2023-09-23 15:03:25,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:25,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x7516119b to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:25,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@746c6bfd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:25,062 DEBUG [hconnection-0x2d515f49-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:25,065 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:25,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7516119b to 127.0.0.1:55260 2023-09-23 15:03:25,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:25,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-23 15:03:25,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:03:25,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-23 15:03:25,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-23 15:03:25,074 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-23 15:03:25,074 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695482005074 2023-09-23 15:03:25,074 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-23 15:03:25,078 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:03:25,078 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:03:25,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-23 15:03:25,079 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-23 15:03:25,080 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-23 15:03:25,081 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-23 15:03:25,082 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695482005082 2023-09-23 15:03:25,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,095 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-23 15:03:25,095 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:25,096 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-23 15:03:25,096 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-23 15:03:25,097 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,097 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,098 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:25,098 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:25,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:25,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:25,098 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:25,098 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:25,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:25,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:25,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:25,099 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,099 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:03:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-23 15:03:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-23 15:03:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-23 15:03:25,100 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-23 15:03:25,100 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-23 15:03:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,100 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-23 15:03:25,100 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-23 15:03:25,100 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-23 15:03:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-23 15:03:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-23 15:03:25,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-23 15:03:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-23 15:03:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:25,104 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-23 15:03:25,105 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-23 15:03:25,105 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-23 15:03:25,105 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-23 15:03:25,105 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-23 15:03:25,105 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-23 15:03:25,106 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,108 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,108 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,108 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,108 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:25,108 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:25,108 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,108 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:25,109 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:25,109 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:25,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-23 15:03:25,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55d1c7bc[Count = 0] remaining members to acquire global barrier 2023-09-23 15:03:25,111 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-23 15:03:25,111 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,112 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,112 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,112 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,112 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,112 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:03:25,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,112 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-23 15:03:25,112 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-23 15:03:25,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,112 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-23 15:03:25,112 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:03:25,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,112 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:25,112 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-23 15:03:25,112 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-23 15:03:25,112 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:03:25,112 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. 2023-09-23 15:03:25,112 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:25,113 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. started... 2023-09-23 15:03:25,114 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 99b9fda90b07e7b6186d745b1094747f: 2023-09-23 15:03:25,114 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,114 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:25,114 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf/63f777dd191f4a1e945ce191c07b65bf.2261d4cb6faae3753945d103dd897224->hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/cf/63f777dd191f4a1e945ce191c07b65bf-top, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf/d5997ee4dee94aa8aa12cb630182d78b.6a04f0fd1cbe385d2250e6aadb39a34e->hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/cf/d5997ee4dee94aa8aa12cb630182d78b-top] hfiles 2023-09-23 15:03:25,114 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf/63f777dd191f4a1e945ce191c07b65bf.2261d4cb6faae3753945d103dd897224 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,115 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-23 15:03:25,115 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:25,115 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-23 15:03:25,116 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf/d5997ee4dee94aa8aa12cb630182d78b.6a04f0fd1cbe385d2250e6aadb39a34e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,116 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-23 15:03:25,116 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:25,116 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-23 15:03:25,127 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. completed. 2023-09-23 15:03:25,127 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. 2023-09-23 15:03:25,127 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:25,127 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:25,127 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,127 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-23 15:03:25,127 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:03:25,134 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-23 15:03:25,134 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,134 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:25,134 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-23 15:03:25,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:25,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:25,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:25,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:25,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:25,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:25,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:25,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39421,1695481329509': 2023-09-23 15:03:25,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-23 15:03:25,137 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-23 15:03:25,137 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:03:25,137 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:03:25,137 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,137 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:03:25,139 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,139 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:25,139 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,139 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,139 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:25,139 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,139 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:25,139 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:25,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:25,140 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:25,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:25,140 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:25,142 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,142 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,143 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:25,145 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:25,145 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,145 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:25,145 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:25,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:25,145 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:25,145 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:25,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:25,145 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:25,145 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:25,145 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:25,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,145 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:25,145 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,145 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:25,146 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:25,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:25,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:25,146 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:25,146 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,146 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:25,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:25,146 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:25,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:25,146 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,147 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,166 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-23 15:03:25,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,166 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695481405074Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695481405146 (+72 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695481405146Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695481405149 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695481405159 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695481405166 (+7 ms) 2023-09-23 15:03:25,169 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-23 15:03:25,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 91 msec 2023-09-23 15:03:25,178 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:25,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-23 15:03:25,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:03:25,179 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481405179 2023-09-23 15:03:25,180 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35975, tgtDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481405179, rawTgtDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481405179, srcFsUri=hdfs://localhost:35975, srcDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:03:25,202 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:03:25,202 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-364221715_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481405179, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481405179/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,202 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8, snapshotDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-23 15:03:25,211 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481405179/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:25,227 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:25,228 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:25,228 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:25,228 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:26,104 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-7529096935461983364.jar 2023-09-23 15:03:26,105 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:26,105 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:26,172 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-397137099484191174.jar 2023-09-23 15:03:26,172 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:26,173 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:26,173 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:26,174 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:26,174 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:26,175 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:26,175 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 15:03:26,176 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 15:03:26,176 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 15:03:26,176 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 15:03:26,177 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 15:03:26,177 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 15:03:26,177 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 15:03:26,178 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 15:03:26,178 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 15:03:26,179 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 15:03:26,179 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:26,180 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:26,181 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:03:26,181 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:26,181 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:26,182 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:03:26,182 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:03:26,559 WARN [Listener at jenkins-hbase4.apache.org/46353] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 15:03:26,560 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0004_000001 (auth:SIMPLE) 2023-09-23 15:03:26,565 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-23 15:03:26,568 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-23 15:03:26,626 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:03:26,627 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:03:27,207 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 15:03:27,470 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0005_000001 (auth:SIMPLE) 2023-09-23 15:03:31,402 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0005_000001 (auth:SIMPLE) 2023-09-23 15:03:33,627 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0005_000001 (auth:SIMPLE) 2023-09-23 15:03:36,122 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0005_000001 (auth:SIMPLE) 2023-09-23 15:03:37,733 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 15:03:37,734 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 15:03:37,744 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:37,744 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 15:03:37,745 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 15:03:37,745 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1038652771_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:37,745 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-23 15:03:37,745 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-23 15:03:37,745 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1038652771_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481405179/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481405179/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:37,746 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481405179/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-23 15:03:37,746 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481405179/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-23 15:03:37,752 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:37,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:37,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:37,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-23 15:03:37,757 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481417757"}]},"ts":"1695481417757"} 2023-09-23 15:03:37,758 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-23 15:03:37,760 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-23 15:03:37,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99b9fda90b07e7b6186d745b1094747f, UNASSIGN}] 2023-09-23 15:03:37,763 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99b9fda90b07e7b6186d745b1094747f, UNASSIGN 2023-09-23 15:03:37,763 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=99b9fda90b07e7b6186d745b1094747f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:37,764 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695481417763"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481417763"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481417763"}]},"ts":"1695481417763"} 2023-09-23 15:03:37,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 99b9fda90b07e7b6186d745b1094747f, server=jenkins-hbase4.apache.org,39421,1695481329509}] 2023-09-23 15:03:37,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-23 15:03:37,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 99b9fda90b07e7b6186d745b1094747f 2023-09-23 15:03:37,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 99b9fda90b07e7b6186d745b1094747f, disabling compactions & flushes 2023-09-23 15:03:37,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. 2023-09-23 15:03:37,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. 2023-09-23 15:03:37,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. after waiting 0 ms 2023-09-23 15:03:37,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. 2023-09-23 15:03:37,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-23 15:03:37,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:03:37,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f. 2023-09-23 15:03:37,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 99b9fda90b07e7b6186d745b1094747f: 2023-09-23 15:03:37,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 99b9fda90b07e7b6186d745b1094747f 2023-09-23 15:03:37,933 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=99b9fda90b07e7b6186d745b1094747f, regionState=CLOSED 2023-09-23 15:03:37,933 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695481417933"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481417933"}]},"ts":"1695481417933"} 2023-09-23 15:03:37,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-23 15:03:37,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 99b9fda90b07e7b6186d745b1094747f, server=jenkins-hbase4.apache.org,39421,1695481329509 in 169 msec 2023-09-23 15:03:37,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-23 15:03:37,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99b9fda90b07e7b6186d745b1094747f, UNASSIGN in 175 msec 2023-09-23 15:03:37,938 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481417937"}]},"ts":"1695481417937"} 2023-09-23 15:03:37,939 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-23 15:03:37,940 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-23 15:03:37,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 188 msec 2023-09-23 15:03:38,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-23 15:03:38,060 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-23 15:03:38,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,064 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,064 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,065 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,068 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:38,068 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:38,068 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f 2023-09-23 15:03:38,069 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,069 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,070 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,070 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 15:03:38,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 15:03:38,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 15:03:38,071 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/recovered.edits] 2023-09-23 15:03:38,071 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/recovered.edits] 2023-09-23 15:03:38,071 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,071 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,071 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/recovered.edits] 2023-09-23 15:03:38,071 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:38,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-23 15:03:38,071 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:38,071 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:38,071 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,072 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:38,071 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 15:03:38,072 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:38,072 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:38,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:38,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-23 15:03:38,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:38,076 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf/63f777dd191f4a1e945ce191c07b65bf.2261d4cb6faae3753945d103dd897224 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf/63f777dd191f4a1e945ce191c07b65bf.2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:38,076 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/cf/63f777dd191f4a1e945ce191c07b65bf to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/cf/63f777dd191f4a1e945ce191c07b65bf 2023-09-23 15:03:38,076 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/cf/d5997ee4dee94aa8aa12cb630182d78b to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/cf/d5997ee4dee94aa8aa12cb630182d78b 2023-09-23 15:03:38,078 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf/d5997ee4dee94aa8aa12cb630182d78b.6a04f0fd1cbe385d2250e6aadb39a34e to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/cf/d5997ee4dee94aa8aa12cb630182d78b.6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:38,081 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/recovered.edits/8.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224/recovered.edits/8.seqid 2023-09-23 15:03:38,081 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/recovered.edits/8.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e/recovered.edits/8.seqid 2023-09-23 15:03:38,081 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2261d4cb6faae3753945d103dd897224 2023-09-23 15:03:38,081 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6a04f0fd1cbe385d2250e6aadb39a34e 2023-09-23 15:03:38,082 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/recovered.edits/12.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f/recovered.edits/12.seqid 2023-09-23 15:03:38,082 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99b9fda90b07e7b6186d745b1094747f 2023-09-23 15:03:38,082 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-23 15:03:38,084 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,087 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-23 15:03:38,089 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-23 15:03:38,090 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,090 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-23 15:03:38,090 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481418090"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:38,092 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-23 15:03:38,092 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 99b9fda90b07e7b6186d745b1094747f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695481403290.99b9fda90b07e7b6186d745b1094747f.', STARTKEY => '', ENDKEY => ''}] 2023-09-23 15:03:38,092 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-23 15:03:38,092 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695481418092"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:38,094 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-23 15:03:38,096 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,097 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 36 msec 2023-09-23 15:03:38,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-23 15:03:38,175 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-23 15:03:38,175 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-23 15:03:38,180 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481418180"}]},"ts":"1695481418180"} 2023-09-23 15:03:38,181 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-23 15:03:38,183 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-23 15:03:38,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e0e3ea3fef365f5406b25ca90c74e08, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=186c0c91e45cebbd62decbce5f7b6744, UNASSIGN}] 2023-09-23 15:03:38,186 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e0e3ea3fef365f5406b25ca90c74e08, UNASSIGN 2023-09-23 15:03:38,186 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=186c0c91e45cebbd62decbce5f7b6744, UNASSIGN 2023-09-23 15:03:38,187 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9e0e3ea3fef365f5406b25ca90c74e08, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:38,187 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695481418186"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481418186"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481418186"}]},"ts":"1695481418186"} 2023-09-23 15:03:38,187 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=186c0c91e45cebbd62decbce5f7b6744, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:38,187 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695481418187"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481418187"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481418187"}]},"ts":"1695481418187"} 2023-09-23 15:03:38,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 9e0e3ea3fef365f5406b25ca90c74e08, server=jenkins-hbase4.apache.org,39755,1695481329466}] 2023-09-23 15:03:38,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 186c0c91e45cebbd62decbce5f7b6744, server=jenkins-hbase4.apache.org,40421,1695481329420}] 2023-09-23 15:03:38,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-23 15:03:38,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:38,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9e0e3ea3fef365f5406b25ca90c74e08, disabling compactions & flushes 2023-09-23 15:03:38,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:38,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:38,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. after waiting 0 ms 2023-09-23 15:03:38,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:38,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:38,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 186c0c91e45cebbd62decbce5f7b6744, disabling compactions & flushes 2023-09-23 15:03:38,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:38,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:38,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. after waiting 0 ms 2023-09-23 15:03:38,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:38,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:03:38,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:03:38,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:03:38,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08. 2023-09-23 15:03:38,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9e0e3ea3fef365f5406b25ca90c74e08: 2023-09-23 15:03:38,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:03:38,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744. 2023-09-23 15:03:38,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 186c0c91e45cebbd62decbce5f7b6744: 2023-09-23 15:03:38,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:38,367 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9e0e3ea3fef365f5406b25ca90c74e08, regionState=CLOSED 2023-09-23 15:03:38,367 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695481418367"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481418367"}]},"ts":"1695481418367"} 2023-09-23 15:03:38,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:38,368 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=186c0c91e45cebbd62decbce5f7b6744, regionState=CLOSED 2023-09-23 15:03:38,368 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695481418367"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481418367"}]},"ts":"1695481418367"} 2023-09-23 15:03:38,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-23 15:03:38,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 9e0e3ea3fef365f5406b25ca90c74e08, server=jenkins-hbase4.apache.org,39755,1695481329466 in 180 msec 2023-09-23 15:03:38,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-23 15:03:38,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 186c0c91e45cebbd62decbce5f7b6744, server=jenkins-hbase4.apache.org,40421,1695481329420 in 180 msec 2023-09-23 15:03:38,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9e0e3ea3fef365f5406b25ca90c74e08, UNASSIGN in 186 msec 2023-09-23 15:03:38,372 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-23 15:03:38,372 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=186c0c91e45cebbd62decbce5f7b6744, UNASSIGN in 187 msec 2023-09-23 15:03:38,373 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481418373"}]},"ts":"1695481418373"} 2023-09-23 15:03:38,374 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-23 15:03:38,377 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-23 15:03:38,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 201 msec 2023-09-23 15:03:38,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-23 15:03:38,483 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-23 15:03:38,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,487 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,487 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,488 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,491 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,491 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,491 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,491 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,492 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 15:03:38,492 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:38,492 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 15:03:38,492 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 15:03:38,492 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:38,492 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 15:03:38,493 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,493 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,493 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,493 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,493 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:38,493 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:38,493 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:38,493 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:38,494 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/recovered.edits] 2023-09-23 15:03:38,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-23 15:03:38,494 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/recovered.edits] 2023-09-23 15:03:38,498 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/cf/665ab962b0cc48b3998d075581d15726 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/cf/665ab962b0cc48b3998d075581d15726 2023-09-23 15:03:38,498 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/cf/fd6b7b43c0a64ea1a1acab408325a5fe to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/cf/fd6b7b43c0a64ea1a1acab408325a5fe 2023-09-23 15:03:38,500 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/recovered.edits/9.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08/recovered.edits/9.seqid 2023-09-23 15:03:38,500 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/recovered.edits/9.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744/recovered.edits/9.seqid 2023-09-23 15:03:38,501 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9e0e3ea3fef365f5406b25ca90c74e08 2023-09-23 15:03:38,501 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/186c0c91e45cebbd62decbce5f7b6744 2023-09-23 15:03:38,501 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-23 15:03:38,501 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-23 15:03:38,502 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-23 15:03:38,505 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923e0cf1c5fbc604c42ace6c165fcd41363 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923e0cf1c5fbc604c42ace6c165fcd41363 2023-09-23 15:03:38,506 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092398b2ff4489bd4a328ff486dadd999d56 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023092398b2ff4489bd4a328ff486dadd999d56 2023-09-23 15:03:38,507 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-23 15:03:38,509 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,511 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-23 15:03:38,512 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-23 15:03:38,514 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,514 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-23 15:03:38,514 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481418514"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:38,514 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481418514"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:38,515 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 15:03:38,515 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9e0e3ea3fef365f5406b25ca90c74e08, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695481401921.9e0e3ea3fef365f5406b25ca90c74e08.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 186c0c91e45cebbd62decbce5f7b6744, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695481401921.186c0c91e45cebbd62decbce5f7b6744.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 15:03:38,515 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-23 15:03:38,515 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695481418515"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:38,517 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-23 15:03:38,519 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-09-23 15:03:38,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-23 15:03:38,596 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-23 15:03:38,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-23 15:03:38,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-23 15:03:38,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 15:03:38,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-23 15:03:38,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 15:03:38,638 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 749) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:55392 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:55896 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3960 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x584d500e-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:46466 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:39837 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x584d500e-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:55900 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1609744628_1 at /127.0.0.1:46436 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=178 (was 190), ProcessCount=168 (was 168), AvailableMemoryMB=1225 (was 1280) 2023-09-23 15:03:38,638 WARN [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-23 15:03:38,659 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=178, ProcessCount=168, AvailableMemoryMB=1225 2023-09-23 15:03:38,659 WARN [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-09-23 15:03:38,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 15:03:38,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 15:03:38,664 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 15:03:38,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-23 15:03:38,665 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 15:03:38,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 15:03:38,667 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:38,667 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:38,668 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9 empty. 2023-09-23 15:03:38,668 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363 empty. 2023-09-23 15:03:38,668 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:38,668 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:38,668 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-23 15:03:38,677 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-23 15:03:38,679 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 95e183212d8da06e362a5c538aa4c363, NAME => 'testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:03:38,679 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 57b40dcd740607dfe4427b1c0eada8a9, NAME => 'testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:03:38,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:38,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:38,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 95e183212d8da06e362a5c538aa4c363, disabling compactions & flushes 2023-09-23 15:03:38,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 57b40dcd740607dfe4427b1c0eada8a9, disabling compactions & flushes 2023-09-23 15:03:38,687 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:38,687 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:38,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:38,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:38,687 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. after waiting 0 ms 2023-09-23 15:03:38,688 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. after waiting 0 ms 2023-09-23 15:03:38,688 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:38,688 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:38,688 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:38,688 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:38,688 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 95e183212d8da06e362a5c538aa4c363: 2023-09-23 15:03:38,688 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 57b40dcd740607dfe4427b1c0eada8a9: 2023-09-23 15:03:38,690 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 15:03:38,691 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695481418691"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481418691"}]},"ts":"1695481418691"} 2023-09-23 15:03:38,691 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695481418691"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481418691"}]},"ts":"1695481418691"} 2023-09-23 15:03:38,693 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 15:03:38,694 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 15:03:38,694 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481418694"}]},"ts":"1695481418694"} 2023-09-23 15:03:38,695 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-23 15:03:38,698 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 15:03:38,700 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 15:03:38,700 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 15:03:38,700 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 15:03:38,700 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 15:03:38,700 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=57b40dcd740607dfe4427b1c0eada8a9, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95e183212d8da06e362a5c538aa4c363, ASSIGN}] 2023-09-23 15:03:38,703 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95e183212d8da06e362a5c538aa4c363, ASSIGN 2023-09-23 15:03:38,703 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=57b40dcd740607dfe4427b1c0eada8a9, ASSIGN 2023-09-23 15:03:38,703 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95e183212d8da06e362a5c538aa4c363, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40421,1695481329420; forceNewPlan=false, retain=false 2023-09-23 15:03:38,703 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=57b40dcd740607dfe4427b1c0eada8a9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39421,1695481329509; forceNewPlan=false, retain=false 2023-09-23 15:03:38,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 15:03:38,854 INFO [jenkins-hbase4:40555] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 15:03:38,857 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=57b40dcd740607dfe4427b1c0eada8a9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:38,857 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=95e183212d8da06e362a5c538aa4c363, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:38,857 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695481418857"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481418857"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481418857"}]},"ts":"1695481418857"} 2023-09-23 15:03:38,857 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695481418857"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481418857"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481418857"}]},"ts":"1695481418857"} 2023-09-23 15:03:38,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 57b40dcd740607dfe4427b1c0eada8a9, server=jenkins-hbase4.apache.org,39421,1695481329509}] 2023-09-23 15:03:38,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 95e183212d8da06e362a5c538aa4c363, server=jenkins-hbase4.apache.org,40421,1695481329420}] 2023-09-23 15:03:38,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 15:03:39,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:39,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:39,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 95e183212d8da06e362a5c538aa4c363, NAME => 'testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 15:03:39,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 57b40dcd740607dfe4427b1c0eada8a9, NAME => 'testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 15:03:39,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. service=AccessControlService 2023-09-23 15:03:39,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. service=AccessControlService 2023-09-23 15:03:39,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:03:39,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:03:39,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:39,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:39,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:39,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:39,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:39,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:39,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:39,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:39,016 INFO [StoreOpener-57b40dcd740607dfe4427b1c0eada8a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:39,016 INFO [StoreOpener-95e183212d8da06e362a5c538aa4c363-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:39,017 DEBUG [StoreOpener-57b40dcd740607dfe4427b1c0eada8a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/cf 2023-09-23 15:03:39,017 DEBUG [StoreOpener-95e183212d8da06e362a5c538aa4c363-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/cf 2023-09-23 15:03:39,017 DEBUG [StoreOpener-95e183212d8da06e362a5c538aa4c363-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/cf 2023-09-23 15:03:39,017 DEBUG [StoreOpener-57b40dcd740607dfe4427b1c0eada8a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/cf 2023-09-23 15:03:39,018 INFO [StoreOpener-95e183212d8da06e362a5c538aa4c363-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95e183212d8da06e362a5c538aa4c363 columnFamilyName cf 2023-09-23 15:03:39,018 INFO [StoreOpener-57b40dcd740607dfe4427b1c0eada8a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57b40dcd740607dfe4427b1c0eada8a9 columnFamilyName cf 2023-09-23 15:03:39,019 INFO [StoreOpener-57b40dcd740607dfe4427b1c0eada8a9-1] regionserver.HStore(310): Store=57b40dcd740607dfe4427b1c0eada8a9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:03:39,019 INFO [StoreOpener-95e183212d8da06e362a5c538aa4c363-1] regionserver.HStore(310): Store=95e183212d8da06e362a5c538aa4c363/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:03:39,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:39,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:39,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:39,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:39,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:39,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:39,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:03:39,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 95e183212d8da06e362a5c538aa4c363; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71203147, jitterRate=0.061009570956230164}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:03:39,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:03:39,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 95e183212d8da06e362a5c538aa4c363: 2023-09-23 15:03:39,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 57b40dcd740607dfe4427b1c0eada8a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64616307, jitterRate=-0.03714199364185333}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:03:39,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 57b40dcd740607dfe4427b1c0eada8a9: 2023-09-23 15:03:39,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363., pid=94, masterSystemTime=1695481419010 2023-09-23 15:03:39,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9., pid=93, masterSystemTime=1695481419010 2023-09-23 15:03:39,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:39,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:39,028 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=95e183212d8da06e362a5c538aa4c363, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:39,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:39,028 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695481419028"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481419028"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481419028"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481419028"}]},"ts":"1695481419028"} 2023-09-23 15:03:39,029 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=57b40dcd740607dfe4427b1c0eada8a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,029 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695481419029"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481419029"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481419029"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481419029"}]},"ts":"1695481419029"} 2023-09-23 15:03:39,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-23 15:03:39,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 95e183212d8da06e362a5c538aa4c363, server=jenkins-hbase4.apache.org,40421,1695481329420 in 171 msec 2023-09-23 15:03:39,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-23 15:03:39,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 57b40dcd740607dfe4427b1c0eada8a9, server=jenkins-hbase4.apache.org,39421,1695481329509 in 172 msec 2023-09-23 15:03:39,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95e183212d8da06e362a5c538aa4c363, ASSIGN in 331 msec 2023-09-23 15:03:39,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-23 15:03:39,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=57b40dcd740607dfe4427b1c0eada8a9, ASSIGN in 332 msec 2023-09-23 15:03:39,034 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 15:03:39,034 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481419034"}]},"ts":"1695481419034"} 2023-09-23 15:03:39,035 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-23 15:03:39,038 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 15:03:39,038 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-23 15:03:39,039 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 15:03:39,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:39,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:39,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:39,042 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:39,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:39,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:39,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:39,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:39,044 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 383 msec 2023-09-23 15:03:39,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 15:03:39,269 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-23 15:03:39,272 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-23 15:03:39,272 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:39,275 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:03:39,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 15:03:39,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481419288 (current time:1695481419288). 2023-09-23 15:03:39,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:03:39,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x57a59852 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:39,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46fa5edd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:39,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:39,302 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:39,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57a59852 to 127.0.0.1:55260 2023-09-23 15:03:39,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:39,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x2e21dfb9 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:39,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@553db527, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:39,313 DEBUG [hconnection-0x41a505eb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:39,314 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:39,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e21dfb9 to 127.0.0.1:55260 2023-09-23 15:03:39,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:39,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 15:03:39,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:03:39,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 15:03:39,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 15:03:39,325 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 15:03:39,325 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695482019325 2023-09-23 15:03:39,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-23 15:03:39,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 15:03:39,327 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:03:39,328 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:03:39,328 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 15:03:39,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 15:03:39,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-23 15:03:39,332 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 15:03:39,333 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695482019333 2023-09-23 15:03:39,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,341 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-23 15:03:39,341 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:39,343 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-23 15:03:39,343 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-23 15:03:39,343 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,343 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,350 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:39,350 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,350 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:39,350 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:39,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:39,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:39,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:39,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:39,351 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:39,351 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,351 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,351 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:03:39,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,352 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 15:03:39,352 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 15:03:39,352 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:39,352 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:39,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,355 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 15:03:39,355 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 15:03:39,355 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:39,354 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 15:03:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 15:03:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 15:03:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 15:03:39,355 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 15:03:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 15:03:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 15:03:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 15:03:39,357 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,357 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,358 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,358 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:39,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:39,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:39,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:39,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:39,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:39,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 15:03:39,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a524ae5[Count = 1] remaining members to acquire global barrier 2023-09-23 15:03:39,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:39,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:39,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:39,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:39,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:39,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 15:03:39,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a524ae5[Count = 0] remaining members to acquire global barrier 2023-09-23 15:03:39,363 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 15:03:39,363 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,364 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,364 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,364 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,365 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,365 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 15:03:39,365 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 15:03:39,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,365 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 15:03:39,365 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:03:39,365 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 15:03:39,365 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:39,365 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:39,365 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,365 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:03:39,365 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:39,365 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. started... 2023-09-23 15:03:39,370 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:39,370 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 95e183212d8da06e362a5c538aa4c363: 2023-09-23 15:03:39,370 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:39,370 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:39,371 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. started... 2023-09-23 15:03:39,371 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,371 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 15:03:39,371 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:39,371 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:39,371 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 57b40dcd740607dfe4427b1c0eada8a9: 2023-09-23 15:03:39,371 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 15:03:39,372 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 15:03:39,373 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,373 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:39,373 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 15:03:39,387 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. completed. 2023-09-23 15:03:39,387 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:39,387 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. completed. 2023-09-23 15:03:39,387 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 15:03:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:03:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 15:03:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:03:39,389 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 15:03:39,389 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 15:03:39,389 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:39,389 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,389 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 15:03:39,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:39,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:39,391 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,389 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:39,391 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 15:03:39,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:39,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:39,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:39,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40421,1695481329420': 2023-09-23 15:03:39,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 15:03:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:39,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39421,1695481329509': 2023-09-23 15:03:39,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 15:03:39,398 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-23 15:03:39,398 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:03:39,398 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:03:39,398 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,398 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:03:39,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:39,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:39,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,400 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:39,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,401 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:39,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,401 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,402 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:39,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,403 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:39,404 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,404 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,408 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,408 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,408 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,408 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:39,408 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:39,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:39,408 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:39,409 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-23 15:03:39,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:39,408 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:39,408 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:39,408 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:39,408 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:39,408 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:39,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:39,410 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:39,410 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:39,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:39,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 15:03:39,410 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,411 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,411 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:39,411 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:39,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:39,411 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,411 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 15:03:39,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,428 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:39,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 15:03:39,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:03:39,429 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 15:03:39,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,439 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-23 15:03:39,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,439 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695481419325Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695481419418 (+93 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695481419418Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695481419418Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695481419422 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695481419433 (+11 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695481419439 (+6 ms) 2023-09-23 15:03:39,443 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 15:03:39,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 117 msec 2023-09-23 15:03:39,629 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:39,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 15:03:39,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:03:39,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39421] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 15:03:39,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40421] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 15:03:39,637 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-23 15:03:39,637 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:39,637 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:03:39,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 15:03:39,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481419649 (current time:1695481419649). 2023-09-23 15:03:39,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:03:39,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x5bae8c3e to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:39,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32cd40fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:39,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:39,661 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:39,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bae8c3e to 127.0.0.1:55260 2023-09-23 15:03:39,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:39,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x74e97fd4 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:39,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b89d20b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:39,670 DEBUG [hconnection-0x31bbb2f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:39,674 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:39,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74e97fd4 to 127.0.0.1:55260 2023-09-23 15:03:39,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:39,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 15:03:39,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:03:39,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 15:03:39,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 15:03:39,683 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 15:03:39,684 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695482019684 2023-09-23 15:03:39,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 15:03:39,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-23 15:03:39,685 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:03:39,685 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:03:39,688 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 15:03:39,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 15:03:39,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-23 15:03:39,690 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 15:03:39,691 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695482019691 2023-09-23 15:03:39,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,700 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-23 15:03:39,700 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:39,701 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-23 15:03:39,701 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-23 15:03:39,702 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,702 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,704 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,704 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:39,704 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:39,704 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:39,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:39,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:39,705 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:39,705 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,705 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,705 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:03:39,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-23 15:03:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-23 15:03:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-23 15:03:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,706 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 15:03:39,706 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 15:03:39,706 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 15:03:39,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,706 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 15:03:39,707 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:39,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,710 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,710 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 15:03:39,711 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 15:03:39,711 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:39,710 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 15:03:39,711 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:39,712 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 15:03:39,712 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 15:03:39,712 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 15:03:39,716 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 15:03:39,716 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 15:03:39,716 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 15:03:39,716 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 15:03:39,716 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 15:03:39,718 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,718 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:39,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:39,719 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,719 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:39,719 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:39,719 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:39,719 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,719 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:39,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,720 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,720 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,720 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:39,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 15:03:39,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a39d4b9[Count = 1] remaining members to acquire global barrier 2023-09-23 15:03:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:39,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:39,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:39,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 15:03:39,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a39d4b9[Count = 0] remaining members to acquire global barrier 2023-09-23 15:03:39,723 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 15:03:39,723 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,732 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,732 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,732 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,732 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,732 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 15:03:39,732 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 15:03:39,732 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 15:03:39,732 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 15:03:39,732 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,732 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:03:39,732 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:03:39,732 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:39,733 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:39,732 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:39,732 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:39,733 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. started... 2023-09-23 15:03:39,733 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:39,733 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:39,733 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. started... 2023-09-23 15:03:39,733 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 95e183212d8da06e362a5c538aa4c363 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-23 15:03:39,733 INFO [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 57b40dcd740607dfe4427b1c0eada8a9 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-23 15:03:39,734 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 15:03:39,734 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:39,734 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 15:03:39,756 INFO [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230923632cea5c913f466ab4213de22b085a60 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230923632cea5c913f466ab4213de22b085a60 2023-09-23 15:03:39,758 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309230f46bcc228084220b4fcc7481a3816a5 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309230f46bcc228084220b4fcc7481a3816a5 2023-09-23 15:03:39,763 INFO [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/.tmp/cf/30369eb23f9048dcaa55d17f6a3639ec 2023-09-23 15:03:39,769 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/.tmp/cf/4e44654d5a7a4d939640e7826546970b 2023-09-23 15:03:39,771 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/.tmp/cf/30369eb23f9048dcaa55d17f6a3639ec as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/cf/30369eb23f9048dcaa55d17f6a3639ec 2023-09-23 15:03:39,775 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/.tmp/cf/4e44654d5a7a4d939640e7826546970b as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/cf/4e44654d5a7a4d939640e7826546970b 2023-09-23 15:03:39,776 INFO [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/cf/30369eb23f9048dcaa55d17f6a3639ec, entries=2, sequenceid=6, filesize=5.2 K 2023-09-23 15:03:39,777 INFO [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 57b40dcd740607dfe4427b1c0eada8a9 in 44ms, sequenceid=6, compaction requested=false 2023-09-23 15:03:39,777 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-23 15:03:39,777 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 57b40dcd740607dfe4427b1c0eada8a9: 2023-09-23 15:03:39,777 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,777 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:39,777 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/cf/30369eb23f9048dcaa55d17f6a3639ec] hfiles 2023-09-23 15:03:39,777 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/cf/30369eb23f9048dcaa55d17f6a3639ec for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,780 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/cf/4e44654d5a7a4d939640e7826546970b, entries=48, sequenceid=6, filesize=13.2 K 2023-09-23 15:03:39,781 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 95e183212d8da06e362a5c538aa4c363 in 48ms, sequenceid=6, compaction requested=false 2023-09-23 15:03:39,782 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 95e183212d8da06e362a5c538aa4c363: 2023-09-23 15:03:39,783 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,783 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:39,783 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/cf/4e44654d5a7a4d939640e7826546970b] hfiles 2023-09-23 15:03:39,783 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/cf/4e44654d5a7a4d939640e7826546970b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,785 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:39,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 15:03:39,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:03:39,786 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 15:03:39,793 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. completed. 2023-09-23 15:03:39,793 DEBUG [rs(jenkins-hbase4.apache.org,39421,1695481329509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:39,793 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:39,793 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:39,793 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,793 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 15:03:39,793 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:03:39,795 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,795 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 15:03:39,795 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:39,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,795 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 15:03:39,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:39,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:39,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:39,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:39,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:39,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39421,1695481329509': 2023-09-23 15:03:39,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 15:03:39,805 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. completed. 2023-09-23 15:03:39,805 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:39,805 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:39,805 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:39,805 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,805 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 15:03:39,805 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:03:39,808 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,808 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 15:03:39,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:39,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:39,808 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:39,808 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 15:03:39,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:39,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:39,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:39,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40421,1695481329420': 2023-09-23 15:03:39,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 15:03:39,812 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-23 15:03:39,812 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:03:39,812 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:03:39,812 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,812 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:03:39,814 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,814 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:39,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:39,814 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:39,814 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,814 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,815 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:39,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:39,815 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,815 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:39,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:39,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:39,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:39,815 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:39,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:39,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:39,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:39,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,816 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:39,817 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,818 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,818 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,821 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:39,821 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:39,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:39,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:39,821 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:39,821 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:39,821 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:39,821 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:39,821 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:39,821 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,821 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:39,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:39,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:39,823 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-23 15:03:39,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:39,823 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:39,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:39,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 15:03:39,823 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,823 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,824 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,824 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:39,824 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,824 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:39,824 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:39,824 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,824 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:39,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:39,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309230f46bcc228084220b4fcc7481a3816a5, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230923632cea5c913f466ab4213de22b085a60] mob files 2023-09-23 15:03:39,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309230f46bcc228084220b4fcc7481a3816a5 2023-09-23 15:03:39,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230923632cea5c913f466ab4213de22b085a60 2023-09-23 15:03:39,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:39,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:39,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,852 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-23 15:03:39,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,852 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:39,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695481419684Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695481419832 (+148 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695481419832Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695481419832Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695481419836 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695481419844 (+8 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695481419852 (+8 ms) 2023-09-23 15:03:39,858 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 15:03:39,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 171 msec 2023-09-23 15:03:39,986 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:39,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 15:03:39,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:03:39,988 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481419988 2023-09-23 15:03:39,988 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35975, tgtDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481419988, rawTgtDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481419988, srcFsUri=hdfs://localhost:35975, srcDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:03:40,011 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:03:40,011 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_305255502_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481419988, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481419988/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:40,011 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8, snapshotDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-23 15:03:40,017 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481419988/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:40,065 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:40,066 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:40,066 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:40,066 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:40,941 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-616089565485927543.jar 2023-09-23 15:03:40,942 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:40,942 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:41,008 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-6710720203435205744.jar 2023-09-23 15:03:41,009 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:41,009 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:41,010 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:41,010 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:41,010 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:41,011 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:41,011 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 15:03:41,011 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 15:03:41,012 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 15:03:41,012 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 15:03:41,012 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 15:03:41,013 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 15:03:41,013 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 15:03:41,014 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 15:03:41,014 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 15:03:41,014 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 15:03:41,015 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:41,015 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:41,016 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:03:41,016 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:41,016 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:41,017 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:03:41,017 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:03:41,381 WARN [Listener at jenkins-hbase4.apache.org/46353] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 15:03:41,383 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-23 15:03:42,295 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:03:42,295 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:03:42,297 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0005_000001 (auth:SIMPLE) 2023-09-23 15:03:42,569 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0006_000001 (auth:SIMPLE) 2023-09-23 15:03:43,520 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 15:03:46,411 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0006_000001 (auth:SIMPLE) 2023-09-23 15:03:48,731 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 15:03:48,732 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 15:03:48,738 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:48,738 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 15:03:48,739 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 15:03:48,739 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1038652771_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:48,739 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-23 15:03:48,740 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-23 15:03:48,740 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1038652771_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481419988/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481419988/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:48,740 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481419988/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-23 15:03:48,740 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481419988/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-23 15:03:48,746 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-23 15:03:48,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-23 15:03:48,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 15:03:48,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-23 15:03:48,752 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481428752"}]},"ts":"1695481428752"} 2023-09-23 15:03:48,753 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-23 15:03:48,755 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-23 15:03:48,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=57b40dcd740607dfe4427b1c0eada8a9, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95e183212d8da06e362a5c538aa4c363, UNASSIGN}] 2023-09-23 15:03:48,758 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=57b40dcd740607dfe4427b1c0eada8a9, UNASSIGN 2023-09-23 15:03:48,758 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95e183212d8da06e362a5c538aa4c363, UNASSIGN 2023-09-23 15:03:48,758 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=95e183212d8da06e362a5c538aa4c363, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:48,758 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=57b40dcd740607dfe4427b1c0eada8a9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:48,759 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695481428758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481428758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481428758"}]},"ts":"1695481428758"} 2023-09-23 15:03:48,759 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695481428758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481428758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481428758"}]},"ts":"1695481428758"} 2023-09-23 15:03:48,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 95e183212d8da06e362a5c538aa4c363, server=jenkins-hbase4.apache.org,40421,1695481329420}] 2023-09-23 15:03:48,761 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 57b40dcd740607dfe4427b1c0eada8a9, server=jenkins-hbase4.apache.org,39421,1695481329509}] 2023-09-23 15:03:48,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-23 15:03:48,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:48,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 95e183212d8da06e362a5c538aa4c363, disabling compactions & flushes 2023-09-23 15:03:48,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:48,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:48,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. after waiting 0 ms 2023-09-23 15:03:48,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:48,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:48,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 57b40dcd740607dfe4427b1c0eada8a9, disabling compactions & flushes 2023-09-23 15:03:48,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:48,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:48,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. after waiting 0 ms 2023-09-23 15:03:48,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:48,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:03:48,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:03:48,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:03:48,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:03:48,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9. 2023-09-23 15:03:48,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363. 2023-09-23 15:03:48,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 57b40dcd740607dfe4427b1c0eada8a9: 2023-09-23 15:03:48,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 95e183212d8da06e362a5c538aa4c363: 2023-09-23 15:03:48,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:48,929 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=57b40dcd740607dfe4427b1c0eada8a9, regionState=CLOSED 2023-09-23 15:03:48,929 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695481428929"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481428929"}]},"ts":"1695481428929"} 2023-09-23 15:03:48,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:48,930 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=95e183212d8da06e362a5c538aa4c363, regionState=CLOSED 2023-09-23 15:03:48,930 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695481428930"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481428930"}]},"ts":"1695481428930"} 2023-09-23 15:03:48,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-23 15:03:48,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 57b40dcd740607dfe4427b1c0eada8a9, server=jenkins-hbase4.apache.org,39421,1695481329509 in 171 msec 2023-09-23 15:03:48,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-23 15:03:48,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 95e183212d8da06e362a5c538aa4c363, server=jenkins-hbase4.apache.org,40421,1695481329420 in 171 msec 2023-09-23 15:03:48,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=57b40dcd740607dfe4427b1c0eada8a9, UNASSIGN in 176 msec 2023-09-23 15:03:48,935 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-23 15:03:48,935 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=95e183212d8da06e362a5c538aa4c363, UNASSIGN in 177 msec 2023-09-23 15:03:48,936 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481428936"}]},"ts":"1695481428936"} 2023-09-23 15:03:48,937 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-23 15:03:48,940 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-23 15:03:48,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 194 msec 2023-09-23 15:03:49,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-23 15:03:49,054 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-23 15:03:49,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,058 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,059 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,061 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,064 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,064 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,064 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,064 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,064 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:49,064 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:49,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 15:03:49,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 15:03:49,066 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 15:03:49,066 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 15:03:49,066 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,066 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:49,066 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,066 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:49,066 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,066 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:49,066 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,066 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:49,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-23 15:03:49,067 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/recovered.edits] 2023-09-23 15:03:49,068 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/recovered.edits] 2023-09-23 15:03:49,073 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/cf/30369eb23f9048dcaa55d17f6a3639ec to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/cf/30369eb23f9048dcaa55d17f6a3639ec 2023-09-23 15:03:49,073 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/cf/4e44654d5a7a4d939640e7826546970b to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/cf/4e44654d5a7a4d939640e7826546970b 2023-09-23 15:03:49,077 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/recovered.edits/9.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9/recovered.edits/9.seqid 2023-09-23 15:03:49,077 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/recovered.edits/9.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363/recovered.edits/9.seqid 2023-09-23 15:03:49,078 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/57b40dcd740607dfe4427b1c0eada8a9 2023-09-23 15:03:49,078 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testEmptyExportFileSystemState/95e183212d8da06e362a5c538aa4c363 2023-09-23 15:03:49,078 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-23 15:03:49,078 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-23 15:03:49,079 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-23 15:03:49,083 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309230f46bcc228084220b4fcc7481a3816a5 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309230f46bcc228084220b4fcc7481a3816a5 2023-09-23 15:03:49,084 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230923632cea5c913f466ab4213de22b085a60 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230923632cea5c913f466ab4213de22b085a60 2023-09-23 15:03:49,085 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-23 15:03:49,087 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,089 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-23 15:03:49,092 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-23 15:03:49,093 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,093 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-23 15:03:49,093 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481429093"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:49,093 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481429093"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:49,095 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 15:03:49,095 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 57b40dcd740607dfe4427b1c0eada8a9, NAME => 'testtb-testEmptyExportFileSystemState,,1695481418660.57b40dcd740607dfe4427b1c0eada8a9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 95e183212d8da06e362a5c538aa4c363, NAME => 'testtb-testEmptyExportFileSystemState,1,1695481418660.95e183212d8da06e362a5c538aa4c363.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 15:03:49,095 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-23 15:03:49,095 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695481429095"}]},"ts":"9223372036854775807"} 2023-09-23 15:03:49,097 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-23 15:03:49,102 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 15:03:49,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 47 msec 2023-09-23 15:03:49,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-23 15:03:49,169 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-23 15:03:49,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-23 15:03:49,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:49,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-23 15:03:49,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-23 15:03:49,208 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 760) Potentially hanging thread: hconnection-0x584d500e-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:44949 from appattempt_1695481336048_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1026959247_17 at /127.0.0.1:48768 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:38580 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_414519015_1 at /127.0.0.1:46976 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:40931 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:42356 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4611 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:43505 from appattempt_1695481336048_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=938 (was 911) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=152 (was 178), ProcessCount=168 (was 168), AvailableMemoryMB=1271 (was 1225) - AvailableMemoryMB LEAK? - 2023-09-23 15:03:49,208 WARN [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-23 15:03:49,228 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=938, MaxFileDescriptor=60000, SystemLoadAverage=152, ProcessCount=168, AvailableMemoryMB=1270 2023-09-23 15:03:49,229 WARN [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-23 15:03:49,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 15:03:49,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,234 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 15:03:49,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-23 15:03:49,235 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 15:03:49,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 15:03:49,237 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:03:49,237 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:03:49,238 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28 empty. 2023-09-23 15:03:49,238 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0 empty. 2023-09-23 15:03:49,238 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:03:49,238 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:03:49,238 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-23 15:03:49,249 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-23 15:03:49,250 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec6e81199f716f60f55c040d0c274a28, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:03:49,250 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9503e6ae5ef1e08da65c444ab3deaac0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp 2023-09-23 15:03:49,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:49,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing ec6e81199f716f60f55c040d0c274a28, disabling compactions & flushes 2023-09-23 15:03:49,268 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:49,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:49,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. after waiting 0 ms 2023-09-23 15:03:49,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:49,268 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:49,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for ec6e81199f716f60f55c040d0c274a28: 2023-09-23 15:03:49,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:49,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 9503e6ae5ef1e08da65c444ab3deaac0, disabling compactions & flushes 2023-09-23 15:03:49,268 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:03:49,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:03:49,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. after waiting 0 ms 2023-09-23 15:03:49,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:03:49,268 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:03:49,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 9503e6ae5ef1e08da65c444ab3deaac0: 2023-09-23 15:03:49,270 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 15:03:49,271 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695481429271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481429271"}]},"ts":"1695481429271"} 2023-09-23 15:03:49,271 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695481429271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481429271"}]},"ts":"1695481429271"} 2023-09-23 15:03:49,274 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 15:03:49,274 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 15:03:49,274 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481429274"}]},"ts":"1695481429274"} 2023-09-23 15:03:49,276 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-23 15:03:49,279 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 15:03:49,280 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 15:03:49,280 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 15:03:49,280 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 15:03:49,280 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 15:03:49,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec6e81199f716f60f55c040d0c274a28, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9503e6ae5ef1e08da65c444ab3deaac0, ASSIGN}] 2023-09-23 15:03:49,283 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9503e6ae5ef1e08da65c444ab3deaac0, ASSIGN 2023-09-23 15:03:49,283 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec6e81199f716f60f55c040d0c274a28, ASSIGN 2023-09-23 15:03:49,284 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9503e6ae5ef1e08da65c444ab3deaac0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40421,1695481329420; forceNewPlan=false, retain=false 2023-09-23 15:03:49,284 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec6e81199f716f60f55c040d0c274a28, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39755,1695481329466; forceNewPlan=false, retain=false 2023-09-23 15:03:49,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 15:03:49,434 INFO [jenkins-hbase4:40555] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 15:03:49,437 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ec6e81199f716f60f55c040d0c274a28, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,437 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9503e6ae5ef1e08da65c444ab3deaac0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,437 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695481429437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481429437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481429437"}]},"ts":"1695481429437"} 2023-09-23 15:03:49,437 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695481429437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481429437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481429437"}]},"ts":"1695481429437"} 2023-09-23 15:03:49,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure ec6e81199f716f60f55c040d0c274a28, server=jenkins-hbase4.apache.org,39755,1695481329466}] 2023-09-23 15:03:49,440 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 9503e6ae5ef1e08da65c444ab3deaac0, server=jenkins-hbase4.apache.org,40421,1695481329420}] 2023-09-23 15:03:49,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 15:03:49,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:49,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:03:49,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec6e81199f716f60f55c040d0c274a28, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 15:03:49,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9503e6ae5ef1e08da65c444ab3deaac0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 15:03:49,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. service=AccessControlService 2023-09-23 15:03:49,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. service=AccessControlService 2023-09-23 15:03:49,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:03:49,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 15:03:49,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:03:49,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:03:49,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:49,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 15:03:49,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:03:49,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:03:49,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:03:49,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:03:49,596 INFO [StoreOpener-ec6e81199f716f60f55c040d0c274a28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:03:49,596 INFO [StoreOpener-9503e6ae5ef1e08da65c444ab3deaac0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:03:49,597 DEBUG [StoreOpener-ec6e81199f716f60f55c040d0c274a28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/cf 2023-09-23 15:03:49,597 DEBUG [StoreOpener-ec6e81199f716f60f55c040d0c274a28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/cf 2023-09-23 15:03:49,597 DEBUG [StoreOpener-9503e6ae5ef1e08da65c444ab3deaac0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/cf 2023-09-23 15:03:49,597 DEBUG [StoreOpener-9503e6ae5ef1e08da65c444ab3deaac0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/cf 2023-09-23 15:03:49,597 INFO [StoreOpener-ec6e81199f716f60f55c040d0c274a28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec6e81199f716f60f55c040d0c274a28 columnFamilyName cf 2023-09-23 15:03:49,597 INFO [StoreOpener-9503e6ae5ef1e08da65c444ab3deaac0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9503e6ae5ef1e08da65c444ab3deaac0 columnFamilyName cf 2023-09-23 15:03:49,599 INFO [StoreOpener-9503e6ae5ef1e08da65c444ab3deaac0-1] regionserver.HStore(310): Store=9503e6ae5ef1e08da65c444ab3deaac0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:03:49,599 INFO [StoreOpener-ec6e81199f716f60f55c040d0c274a28-1] regionserver.HStore(310): Store=ec6e81199f716f60f55c040d0c274a28/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 15:03:49,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:03:49,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:03:49,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:03:49,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:03:49,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:03:49,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:03:49,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:03:49,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 15:03:49,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9503e6ae5ef1e08da65c444ab3deaac0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71057371, jitterRate=0.05883733928203583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:03:49,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec6e81199f716f60f55c040d0c274a28; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63469184, jitterRate=-0.05423545837402344}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 15:03:49,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9503e6ae5ef1e08da65c444ab3deaac0: 2023-09-23 15:03:49,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec6e81199f716f60f55c040d0c274a28: 2023-09-23 15:03:49,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0., pid=109, masterSystemTime=1695481429592 2023-09-23 15:03:49,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28., pid=108, masterSystemTime=1695481429590 2023-09-23 15:03:49,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:49,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:49,607 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ec6e81199f716f60f55c040d0c274a28, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:03:49,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:03:49,608 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695481429607"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481429607"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481429607"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481429607"}]},"ts":"1695481429607"} 2023-09-23 15:03:49,608 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9503e6ae5ef1e08da65c444ab3deaac0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,608 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695481429608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695481429608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695481429608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695481429608"}]},"ts":"1695481429608"} 2023-09-23 15:03:49,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-23 15:03:49,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure ec6e81199f716f60f55c040d0c274a28, server=jenkins-hbase4.apache.org,39755,1695481329466 in 170 msec 2023-09-23 15:03:49,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-23 15:03:49,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 9503e6ae5ef1e08da65c444ab3deaac0, server=jenkins-hbase4.apache.org,40421,1695481329420 in 170 msec 2023-09-23 15:03:49,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec6e81199f716f60f55c040d0c274a28, ASSIGN in 330 msec 2023-09-23 15:03:49,612 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-23 15:03:49,612 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9503e6ae5ef1e08da65c444ab3deaac0, ASSIGN in 331 msec 2023-09-23 15:03:49,613 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 15:03:49,613 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481429613"}]},"ts":"1695481429613"} 2023-09-23 15:03:49,614 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-23 15:03:49,616 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 15:03:49,616 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-23 15:03:49,618 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-23 15:03:49,620 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:49,620 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:49,620 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:49,620 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:03:49,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:49,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:49,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:49,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 15:03:49,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 391 msec 2023-09-23 15:03:49,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 15:03:49,839 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-23 15:03:49,841 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,841 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:49,843 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:03:49,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 15:03:49,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481429855 (current time:1695481429855). 2023-09-23 15:03:49,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:03:49,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x0dc1b15a to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:49,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11d8aa10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:49,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:49,865 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:49,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dc1b15a to 127.0.0.1:55260 2023-09-23 15:03:49,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:49,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x297e794a to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:49,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2935565e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:49,875 DEBUG [hconnection-0x7d69f142-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:49,878 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:49,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x297e794a to 127.0.0.1:55260 2023-09-23 15:03:49,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:49,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-23 15:03:49,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:03:49,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 15:03:49,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 15:03:49,887 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 15:03:49,888 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695482029888 2023-09-23 15:03:49,888 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 15:03:49,889 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:03:49,889 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:03:49,890 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 15:03:49,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 15:03:49,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-23 15:03:49,892 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 15:03:49,892 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695482029892 2023-09-23 15:03:49,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,907 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-23 15:03:49,907 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:49,909 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-23 15:03:49,909 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-23 15:03:49,910 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,910 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,911 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:49,911 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:49,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:49,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:49,912 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:49,912 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,912 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,912 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,913 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,913 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:03:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-23 15:03:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-23 15:03:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,913 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 15:03:49,913 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 15:03:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-23 15:03:49,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,914 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 15:03:49,914 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 15:03:49,914 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:49,915 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 15:03:49,915 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 15:03:49,915 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 15:03:49,915 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,915 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,916 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 15:03:49,916 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:49,916 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 15:03:49,917 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:49,917 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 15:03:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 15:03:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 15:03:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 15:03:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 15:03:49,918 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 15:03:49,927 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,927 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:49,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:49,928 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,928 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:49,928 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,928 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,928 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:49,928 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,928 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:49,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:49,929 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,929 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:49,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:49,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:49,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 15:03:49,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31ed6f3e[Count = 1] remaining members to acquire global barrier 2023-09-23 15:03:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:49,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:49,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:49,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 15:03:49,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31ed6f3e[Count = 0] remaining members to acquire global barrier 2023-09-23 15:03:49,932 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-23 15:03:49,932 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,933 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,933 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,933 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,933 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 15:03:49,933 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 15:03:49,933 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,933 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:49,934 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:49,933 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 15:03:49,934 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:03:49,934 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:49,934 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,934 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. started... 2023-09-23 15:03:49,934 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:03:49,934 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. started... 2023-09-23 15:03:49,934 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 15:03:49,934 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:49,934 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:03:49,934 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:49,936 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec6e81199f716f60f55c040d0c274a28: 2023-09-23 15:03:49,936 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9503e6ae5ef1e08da65c444ab3deaac0: 2023-09-23 15:03:49,936 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,936 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,936 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:49,936 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:49,936 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 15:03:49,936 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 15:03:49,937 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 15:03:49,937 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:49,937 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 15:03:49,950 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. completed. 2023-09-23 15:03:49,950 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:49,950 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. completed. 2023-09-23 15:03:49,950 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:03:49,950 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:49,950 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:49,950 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:49,950 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 15:03:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 15:03:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:03:49,951 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:03:49,959 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 15:03:49,959 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,959 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 15:03:49,959 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:49,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:49,959 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:49,959 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:49,959 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 15:03:49,961 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 15:03:49,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:49,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:49,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:49,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:49,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:49,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40421,1695481329420': 2023-09-23 15:03:49,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-23 15:03:49,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:49,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:49,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:49,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:49,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:49,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:49,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:49,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39755,1695481329466': 2023-09-23 15:03:49,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-23 15:03:49,970 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-23 15:03:49,970 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:03:49,970 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:03:49,970 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,970 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:03:49,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:49,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:49,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,973 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:49,972 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:49,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:49,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:49,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:49,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:49,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:49,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:49,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:49,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:49,974 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:49,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,974 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:49,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:49,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,976 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:49,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:49,976 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,976 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:49,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,979 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,979 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,979 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:49,979 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:49,979 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:49,979 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:49,979 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:49,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:49,979 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:49,979 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:49,979 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:49,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:49,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:49,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:49,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:49,979 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:49,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:49,981 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,981 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:49,981 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:49,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,981 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 15:03:49,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:49,981 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:49,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:49,981 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:49,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:49,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:49,982 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,982 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 15:03:49,989 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:49,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 15:03:49,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:03:49,991 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 15:03:49,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:49,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-23 15:03:50,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,009 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695481429888Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695481429992 (+104 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695481429992Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695481429993 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695481429996 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695481430003 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695481430009 (+6 ms) 2023-09-23 15:03:50,012 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 15:03:50,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 123 msec 2023-09-23 15:03:50,191 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:50,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 15:03:50,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:03:50,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39755] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 15:03:50,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40421] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 15:03:50,198 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,198 DEBUG [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:50,198 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 15:03:50,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 15:03:50,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695481430208 (current time:1695481430208). 2023-09-23 15:03:50,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 15:03:50,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x260d64b9 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:50,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@145c72db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:50,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:50,220 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:50,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x260d64b9 to 127.0.0.1:55260 2023-09-23 15:03:50,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:50,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(139): Connect 0x3a88ea99 to 127.0.0.1:55260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 15:03:50,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@776d79dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 15:03:50,229 DEBUG [hconnection-0x501741-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 15:03:50,230 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 15:03:50,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a88ea99 to 127.0.0.1:55260 2023-09-23 15:03:50,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:03:50,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-23 15:03:50,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 15:03:50,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 15:03:50,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 15:03:50,240 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 15:03:50,240 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695482030240 2023-09-23 15:03:50,240 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 15:03:50,242 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 15:03:50,242 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 15:03:50,243 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 15:03:50,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 15:03:50,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-23 15:03:50,244 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 15:03:50,245 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695482030245 2023-09-23 15:03:50,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,257 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-23 15:03:50,257 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:50,258 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-23 15:03:50,258 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-23 15:03:50,259 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,259 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,260 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:50,260 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:50,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:50,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:50,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:50,260 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:50,260 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:50,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:50,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:50,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,261 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,261 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,261 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,261 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,261 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 15:03:50,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,262 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 15:03:50,262 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 15:03:50,262 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:50,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,262 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 15:03:50,263 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,263 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:50,263 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 15:03:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 15:03:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 15:03:50,263 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 15:03:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 15:03:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39421,1695481329509' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 15:03:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 15:03:50,265 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 15:03:50,266 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 15:03:50,266 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 15:03:50,266 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 15:03:50,270 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,271 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,271 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:50,271 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 15:03:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:50,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:50,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40421,1695481329420' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 15:03:50,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a5aa298[Count = 1] remaining members to acquire global barrier 2023-09-23 15:03:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:50,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39755,1695481329466' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 15:03:50,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a5aa298[Count = 0] remaining members to acquire global barrier 2023-09-23 15:03:50,275 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-23 15:03:50,275 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,278 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,278 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,278 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 15:03:50,279 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 15:03:50,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:50,279 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 15:03:50,279 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,279 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 15:03:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 15:03:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 15:03:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 15:03:50,279 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39421,1695481329509' in zk 2023-09-23 15:03:50,279 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:03:50,279 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. started... 2023-09-23 15:03:50,279 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. started... 2023-09-23 15:03:50,279 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ec6e81199f716f60f55c040d0c274a28 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-23 15:03:50,279 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9503e6ae5ef1e08da65c444ab3deaac0 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-23 15:03:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 15:03:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,39421,1695481329509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 15:03:50,297 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092328cc714d4c7c4cb48164065d34016613 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092328cc714d4c7c4cb48164065d34016613 2023-09-23 15:03:50,297 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230923dc48d0dc95974962b0b1c9f9aa359949 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923dc48d0dc95974962b0b1c9f9aa359949 2023-09-23 15:03:50,310 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/.tmp/cf/1380cc4892a9428aaff2220ea8da6128 2023-09-23 15:03:50,310 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/.tmp/cf/611ba12090644e0d9c53c82118210942 2023-09-23 15:03:50,315 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/.tmp/cf/1380cc4892a9428aaff2220ea8da6128 as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/cf/1380cc4892a9428aaff2220ea8da6128 2023-09-23 15:03:50,315 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/.tmp/cf/611ba12090644e0d9c53c82118210942 as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/cf/611ba12090644e0d9c53c82118210942 2023-09-23 15:03:50,319 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/cf/1380cc4892a9428aaff2220ea8da6128, entries=48, sequenceid=6, filesize=13.5 K 2023-09-23 15:03:50,320 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/cf/611ba12090644e0d9c53c82118210942, entries=2, sequenceid=6, filesize=5.2 K 2023-09-23 15:03:50,320 INFO [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 9503e6ae5ef1e08da65c444ab3deaac0 in 41ms, sequenceid=6, compaction requested=false 2023-09-23 15:03:50,320 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-23 15:03:50,321 INFO [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for ec6e81199f716f60f55c040d0c274a28 in 42ms, sequenceid=6, compaction requested=false 2023-09-23 15:03:50,321 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-23 15:03:50,324 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec6e81199f716f60f55c040d0c274a28: 2023-09-23 15:03:50,324 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9503e6ae5ef1e08da65c444ab3deaac0: 2023-09-23 15:03:50,324 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,324 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,324 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:50,324 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 15:03:50,324 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/cf/611ba12090644e0d9c53c82118210942] hfiles 2023-09-23 15:03:50,324 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/cf/1380cc4892a9428aaff2220ea8da6128] hfiles 2023-09-23 15:03:50,324 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/cf/611ba12090644e0d9c53c82118210942 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,324 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/cf/1380cc4892a9428aaff2220ea8da6128 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,332 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. completed. 2023-09-23 15:03:50,332 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. completed. 2023-09-23 15:03:50,332 DEBUG [rs(jenkins-hbase4.apache.org,40421,1695481329420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:03:50,332 DEBUG [rs(jenkins-hbase4.apache.org,39755,1695481329466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:03:50,332 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:50,332 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:50,332 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 15:03:50,332 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 15:03:50,332 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,332 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,332 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 15:03:50,332 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 15:03:50,332 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39755,1695481329466' in zk 2023-09-23 15:03:50,332 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40421,1695481329420' in zk 2023-09-23 15:03:50,334 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 15:03:50,334 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 15:03:50,334 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:50,334 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,334 DEBUG [member: 'jenkins-hbase4.apache.org,39755,1695481329466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 15:03:50,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:50,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:50,334 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:50,335 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,336 DEBUG [member: 'jenkins-hbase4.apache.org,40421,1695481329420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 15:03:50,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:50,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:50,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:50,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:50,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:50,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39755,1695481329466': 2023-09-23 15:03:50,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39755,1695481329466' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-23 15:03:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:50,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:50,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,342 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40421,1695481329420': 2023-09-23 15:03:50,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40421,1695481329420' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-23 15:03:50,342 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-23 15:03:50,342 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 15:03:50,342 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 15:03:50,343 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,343 INFO [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 15:03:50,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 15:03:50,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-23 15:03:50,343 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 15:03:50,344 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,344 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 15:03:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 15:03:50,344 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,344 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,345 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:50,345 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:50,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,344 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 15:03:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,345 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:50,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:50,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:50,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:50,345 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 15:03:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,346 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 15:03:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,347 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:50,348 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,348 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,351 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,351 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,351 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,351 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:50,351 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:50,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:50,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:50,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:50,351 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:50,351 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:50,351 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 15:03:50,351 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:50,351 DEBUG [(jenkins-hbase4.apache.org,40555,1695481328153)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 15:03:50,351 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:50,351 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,351 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:03:50,353 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,353 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 15:03:50,351 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 15:03:50,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 15:03:50,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,353 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:03:50,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 15:03:50,353 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:03:50,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:50,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:50,353 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,353 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:50,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 15:03:50,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923dc48d0dc95974962b0b1c9f9aa359949, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092328cc714d4c7c4cb48164065d34016613] mob files 2023-09-23 15:03:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:50,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923dc48d0dc95974962b0b1c9f9aa359949 2023-09-23 15:03:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 15:03:50,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092328cc714d4c7c4cb48164065d34016613 2023-09-23 15:03:50,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,377 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-23 15:03:50,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,377 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695481430240Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695481430360 (+120 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695481430360Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695481430361 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695481430363 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695481430370 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695481430377 (+7 ms) 2023-09-23 15:03:50,380 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 15:03:50,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 139 msec 2023-09-23 15:03:50,543 DEBUG [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 15:03:50,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 15:03:50,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 15:03:50,545 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481430545 2023-09-23 15:03:50,545 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35975, tgtDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481430545, rawTgtDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481430545, srcFsUri=hdfs://localhost:35975, srcDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:03:50,567 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8 2023-09-23 15:03:50,567 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_689332623_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481430545, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481430545/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,567 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35975, inputRoot=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8, snapshotDir=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-23 15:03:50,578 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481430545/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:03:50,601 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:50,601 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:50,602 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:50,602 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:51,475 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-5978313461584962095.jar 2023-09-23 15:03:51,476 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:51,476 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:51,543 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/hadoop-7534727562925974768.jar 2023-09-23 15:03:51,543 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:51,544 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:51,544 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:51,544 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:51,545 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:51,545 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 15:03:51,545 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 15:03:51,546 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 15:03:51,546 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 15:03:51,546 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 15:03:51,547 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 15:03:51,547 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 15:03:51,547 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 15:03:51,548 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 15:03:51,548 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 15:03:51,549 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 15:03:51,549 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:51,550 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:51,550 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:03:51,550 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:51,550 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 15:03:51,551 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:03:51,552 DEBUG [Listener at jenkins-hbase4.apache.org/46353] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 15:03:51,914 WARN [Listener at jenkins-hbase4.apache.org/46353] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 15:03:51,917 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-23 15:03:51,919 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-23 15:03:53,754 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:03:53,754 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 15:03:53,758 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0006_000001 (auth:SIMPLE) 2023-09-23 15:03:54,309 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0007_000001 (auth:SIMPLE) 2023-09-23 15:03:54,509 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 15:03:58,134 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0007_000001 (auth:SIMPLE) 2023-09-23 15:04:00,348 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0007_000001 (auth:SIMPLE) 2023-09-23 15:04:02,903 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695481336048_0007_000001 (auth:SIMPLE) 2023-09-23 15:04:04,078 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 15:04:04,078 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 15:04:04,089 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,089 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 15:04:04,090 INFO [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 15:04:04,090 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1038652771_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,090 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-23 15:04:04,090 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-23 15:04:04,091 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1038652771_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481430545/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481430545/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,091 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481430545/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-23 15:04:04,091 DEBUG [Listener at jenkins-hbase4.apache.org/46353] snapshot.TestExportSnapshot(367): hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/export-test/export-1695481430545/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-23 15:04:04,097 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-23 15:04:04,101 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481444101"}]},"ts":"1695481444101"} 2023-09-23 15:04:04,103 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-23 15:04:04,104 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-23 15:04:04,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec6e81199f716f60f55c040d0c274a28, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9503e6ae5ef1e08da65c444ab3deaac0, UNASSIGN}] 2023-09-23 15:04:04,107 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec6e81199f716f60f55c040d0c274a28, UNASSIGN 2023-09-23 15:04:04,107 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9503e6ae5ef1e08da65c444ab3deaac0, UNASSIGN 2023-09-23 15:04:04,107 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ec6e81199f716f60f55c040d0c274a28, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:04:04,107 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9503e6ae5ef1e08da65c444ab3deaac0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:04:04,108 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695481444107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481444107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481444107"}]},"ts":"1695481444107"} 2023-09-23 15:04:04,108 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695481444107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695481444107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695481444107"}]},"ts":"1695481444107"} 2023-09-23 15:04:04,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure ec6e81199f716f60f55c040d0c274a28, server=jenkins-hbase4.apache.org,39755,1695481329466}] 2023-09-23 15:04:04,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 9503e6ae5ef1e08da65c444ab3deaac0, server=jenkins-hbase4.apache.org,40421,1695481329420}] 2023-09-23 15:04:04,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-23 15:04:04,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:04:04,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:04:04,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec6e81199f716f60f55c040d0c274a28, disabling compactions & flushes 2023-09-23 15:04:04,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9503e6ae5ef1e08da65c444ab3deaac0, disabling compactions & flushes 2023-09-23 15:04:04,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:04:04,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:04:04,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:04:04,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:04:04,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. after waiting 0 ms 2023-09-23 15:04:04,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:04:04,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. after waiting 0 ms 2023-09-23 15:04:04,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:04:04,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:04:04,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:04:04,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:04:04,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:04:04,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0. 2023-09-23 15:04:04,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28. 2023-09-23 15:04:04,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9503e6ae5ef1e08da65c444ab3deaac0: 2023-09-23 15:04:04,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec6e81199f716f60f55c040d0c274a28: 2023-09-23 15:04:04,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:04:04,280 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ec6e81199f716f60f55c040d0c274a28, regionState=CLOSED 2023-09-23 15:04:04,280 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695481444280"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481444280"}]},"ts":"1695481444280"} 2023-09-23 15:04:04,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:04:04,281 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9503e6ae5ef1e08da65c444ab3deaac0, regionState=CLOSED 2023-09-23 15:04:04,281 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695481444280"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695481444280"}]},"ts":"1695481444280"} 2023-09-23 15:04:04,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-23 15:04:04,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure ec6e81199f716f60f55c040d0c274a28, server=jenkins-hbase4.apache.org,39755,1695481329466 in 172 msec 2023-09-23 15:04:04,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-23 15:04:04,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 9503e6ae5ef1e08da65c444ab3deaac0, server=jenkins-hbase4.apache.org,40421,1695481329420 in 172 msec 2023-09-23 15:04:04,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec6e81199f716f60f55c040d0c274a28, UNASSIGN in 179 msec 2023-09-23 15:04:04,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-23 15:04:04,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9503e6ae5ef1e08da65c444ab3deaac0, UNASSIGN in 180 msec 2023-09-23 15:04:04,286 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695481444286"}]},"ts":"1695481444286"} 2023-09-23 15:04:04,287 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-23 15:04:04,289 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-23 15:04:04,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 192 msec 2023-09-23 15:04:04,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-23 15:04:04,404 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-23 15:04:04,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,407 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,408 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,409 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39755] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,412 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:04:04,412 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:04:04,413 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,413 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,413 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,413 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 15:04:04,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 15:04:04,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 15:04:04,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 15:04:04,414 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/recovered.edits] 2023-09-23 15:04:04,414 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/cf, FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/recovered.edits] 2023-09-23 15:04:04,415 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,415 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,415 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:04:04,415 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,415 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:04:04,415 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,415 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:04:04,415 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 15:04:04,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-23 15:04:04,419 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/cf/611ba12090644e0d9c53c82118210942 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/cf/611ba12090644e0d9c53c82118210942 2023-09-23 15:04:04,419 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/cf/1380cc4892a9428aaff2220ea8da6128 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/cf/1380cc4892a9428aaff2220ea8da6128 2023-09-23 15:04:04,423 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/recovered.edits/9.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28/recovered.edits/9.seqid 2023-09-23 15:04:04,423 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/recovered.edits/9.seqid to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0/recovered.edits/9.seqid 2023-09-23 15:04:04,423 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec6e81199f716f60f55c040d0c274a28 2023-09-23 15:04:04,423 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9503e6ae5ef1e08da65c444ab3deaac0 2023-09-23 15:04:04,423 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-23 15:04:04,424 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-23 15:04:04,425 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-23 15:04:04,429 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923dc48d0dc95974962b0b1c9f9aa359949 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923dc48d0dc95974962b0b1c9f9aa359949 2023-09-23 15:04:04,430 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092328cc714d4c7c4cb48164065d34016613 to hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023092328cc714d4c7c4cb48164065d34016613 2023-09-23 15:04:04,431 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-23 15:04:04,433 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,435 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-23 15:04:04,437 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-23 15:04:04,438 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,438 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-23 15:04:04,439 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481444438"}]},"ts":"9223372036854775807"} 2023-09-23 15:04:04,439 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695481444438"}]},"ts":"9223372036854775807"} 2023-09-23 15:04:04,440 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 15:04:04,440 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ec6e81199f716f60f55c040d0c274a28, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695481429230.ec6e81199f716f60f55c040d0c274a28.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9503e6ae5ef1e08da65c444ab3deaac0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695481429230.9503e6ae5ef1e08da65c444ab3deaac0.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 15:04:04,440 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-23 15:04:04,441 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695481444441"}]},"ts":"9223372036854775807"} 2023-09-23 15:04:04,442 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-23 15:04:04,444 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 40 msec 2023-09-23 15:04:04,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-23 15:04:04,517 INFO [Listener at jenkins-hbase4.apache.org/46353] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-23 15:04:04,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-23 15:04:04,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-23 15:04:04,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40555] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 15:04:04,552 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 765) Potentially hanging thread: hconnection-0x584d500e-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_214253541_1 at /127.0.0.1:47498 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5218 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:47518 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:38453 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:51282 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x584d500e-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_214253541_1 at /127.0.0.1:51240 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1038652771_17 at /127.0.0.1:52364 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 938), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=163 (was 152) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1117 (was 1270) 2023-09-23 15:04:04,553 WARN [Listener at jenkins-hbase4.apache.org/46353] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-23 15:04:04,553 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-23 15:04:04,563 INFO [Listener at jenkins-hbase4.apache.org/46353] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-23 15:04:04,674 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695481336048_0007_01_000001 is : 143 2023-09-23 15:04:09,851 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 15:04:18,688 INFO [Listener at jenkins-hbase4.apache.org/46353] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-23 15:04:32,806 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-23 15:04:32,807 INFO [Listener at jenkins-hbase4.apache.org/46353] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-23 15:04:32,916 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-23 15:04:32,927 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-23 15:04:32,928 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-23 15:04:32,937 INFO [Listener at jenkins-hbase4.apache.org/46353] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-23 15:04:33,041 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-23 15:04:33,041 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-23 15:04:33,041 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-23 15:04:33,041 INFO [Listener at jenkins-hbase4.apache.org/46353] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-23 15:04:33,041 DEBUG [Listener at jenkins-hbase4.apache.org/46353] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a20d86f to 127.0.0.1:55260 2023-09-23 15:04:33,041 DEBUG [Listener at jenkins-hbase4.apache.org/46353] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:04:33,042 DEBUG [Listener at jenkins-hbase4.apache.org/46353] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-23 15:04:33,042 DEBUG [Listener at jenkins-hbase4.apache.org/46353] util.JVMClusterUtil(257): Found active master hash=1658197941, stopped=false 2023-09-23 15:04:33,042 DEBUG [Listener at jenkins-hbase4.apache.org/46353] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:04:33,042 DEBUG [Listener at jenkins-hbase4.apache.org/46353] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-23 15:04:33,042 INFO [Listener at jenkins-hbase4.apache.org/46353] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40555,1695481328153 2023-09-23 15:04:33,043 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 15:04:33,044 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 15:04:33,044 INFO [Listener at jenkins-hbase4.apache.org/46353] procedure2.ProcedureExecutor(628): Stopping 2023-09-23 15:04:33,044 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 15:04:33,043 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 15:04:33,044 DEBUG [Listener at jenkins-hbase4.apache.org/46353] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55411c59 to 127.0.0.1:55260 2023-09-23 15:04:33,044 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 15:04:33,044 DEBUG [Listener at jenkins-hbase4.apache.org/46353] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:04:33,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 15:04:33,044 INFO [Listener at jenkins-hbase4.apache.org/46353] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40421,1695481329420' ***** 2023-09-23 15:04:33,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 15:04:33,044 DEBUG [Listener at jenkins-hbase4.apache.org/46353] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:04:33,045 INFO [Listener at jenkins-hbase4.apache.org/46353] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-23 15:04:33,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 15:04:33,045 INFO [Listener at jenkins-hbase4.apache.org/46353] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39755,1695481329466' ***** 2023-09-23 15:04:33,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 15:04:33,045 DEBUG [Listener at jenkins-hbase4.apache.org/46353] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:04:33,045 INFO [RS:0;jenkins-hbase4:40421] regionserver.HeapMemoryManager(220): Stopping 2023-09-23 15:04:33,045 INFO [Listener at jenkins-hbase4.apache.org/46353] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-23 15:04:33,045 INFO [Listener at jenkins-hbase4.apache.org/46353] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39421,1695481329509' ***** 2023-09-23 15:04:33,045 DEBUG [Listener at jenkins-hbase4.apache.org/46353] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:04:33,045 INFO [Listener at jenkins-hbase4.apache.org/46353] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-23 15:04:33,045 INFO [RS:1;jenkins-hbase4:39755] regionserver.HeapMemoryManager(220): Stopping 2023-09-23 15:04:33,045 INFO [RS:0;jenkins-hbase4:40421] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-23 15:04:33,045 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-23 15:04:33,045 INFO [RS:1;jenkins-hbase4:39755] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-23 15:04:33,045 INFO [RS:2;jenkins-hbase4:39421] regionserver.HeapMemoryManager(220): Stopping 2023-09-23 15:04:33,045 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-23 15:04:33,046 INFO [RS:2;jenkins-hbase4:39421] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-23 15:04:33,046 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-23 15:04:33,046 INFO [RS:2;jenkins-hbase4:39421] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-23 15:04:33,045 INFO [RS:1;jenkins-hbase4:39755] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-23 15:04:33,045 INFO [RS:0;jenkins-hbase4:40421] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-23 15:04:33,046 INFO [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:04:33,046 INFO [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(3305): Received CLOSE for f60c13d8c45751bc6befef43bb40eff2 2023-09-23 15:04:33,046 DEBUG [RS:0;jenkins-hbase4:40421] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ddad224 to 127.0.0.1:55260 2023-09-23 15:04:33,046 INFO [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(3305): Received CLOSE for 4b8b659b076874d3607df57b2ada0035 2023-09-23 15:04:33,046 DEBUG [RS:0;jenkins-hbase4:40421] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:04:33,048 INFO [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40421,1695481329420; all regions closed. 2023-09-23 15:04:33,048 INFO [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:04:33,048 INFO [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:04:33,048 DEBUG [RS:1;jenkins-hbase4:39755] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3cbc7047 to 127.0.0.1:55260 2023-09-23 15:04:33,048 DEBUG [RS:2;jenkins-hbase4:39421] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43be4382 to 127.0.0.1:55260 2023-09-23 15:04:33,048 DEBUG [RS:1;jenkins-hbase4:39755] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:04:33,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f60c13d8c45751bc6befef43bb40eff2, disabling compactions & flushes 2023-09-23 15:04:33,048 DEBUG [RS:2;jenkins-hbase4:39421] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:04:33,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4b8b659b076874d3607df57b2ada0035, disabling compactions & flushes 2023-09-23 15:04:33,051 INFO [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-23 15:04:33,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. 2023-09-23 15:04:33,050 INFO [RS:1;jenkins-hbase4:39755] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-23 15:04:33,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. 2023-09-23 15:04:33,051 DEBUG [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1478): Online Regions={4b8b659b076874d3607df57b2ada0035=hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035.} 2023-09-23 15:04:33,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. 2023-09-23 15:04:33,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. after waiting 0 ms 2023-09-23 15:04:33,051 INFO [RS:1;jenkins-hbase4:39755] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-23 15:04:33,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. 2023-09-23 15:04:33,051 INFO [RS:1;jenkins-hbase4:39755] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-23 15:04:33,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. 2023-09-23 15:04:33,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f60c13d8c45751bc6befef43bb40eff2 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-23 15:04:33,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. after waiting 0 ms 2023-09-23 15:04:33,051 INFO [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-23 15:04:33,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. 2023-09-23 15:04:33,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4b8b659b076874d3607df57b2ada0035 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-23 15:04:33,052 INFO [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-23 15:04:33,052 DEBUG [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1478): Online Regions={f60c13d8c45751bc6befef43bb40eff2=hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2., 1588230740=hbase:meta,,1.1588230740} 2023-09-23 15:04:33,052 DEBUG [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1504): Waiting on 4b8b659b076874d3607df57b2ada0035 2023-09-23 15:04:33,052 DEBUG [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1504): Waiting on 1588230740, f60c13d8c45751bc6befef43bb40eff2 2023-09-23 15:04:33,053 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-23 15:04:33,053 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-23 15:04:33,053 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-23 15:04:33,053 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-23 15:04:33,053 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-23 15:04:33,053 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-23 15:04:33,070 DEBUG [RS:0;jenkins-hbase4:40421] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/oldWALs 2023-09-23 15:04:33,070 INFO [RS:0;jenkins-hbase4:40421] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40421%2C1695481329420:(num 1695481331262) 2023-09-23 15:04:33,070 DEBUG [RS:0;jenkins-hbase4:40421] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:04:33,070 INFO [RS:0;jenkins-hbase4:40421] regionserver.LeaseManager(133): Closed leases 2023-09-23 15:04:33,073 INFO [RS:0;jenkins-hbase4:40421] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-23 15:04:33,077 INFO [RS:0;jenkins-hbase4:40421] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-23 15:04:33,077 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 15:04:33,077 INFO [RS:0;jenkins-hbase4:40421] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-23 15:04:33,077 INFO [RS:0;jenkins-hbase4:40421] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-23 15:04:33,084 INFO [RS:0;jenkins-hbase4:40421] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40421 2023-09-23 15:04:33,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035/.tmp/info/e24d8cb79c0d41048027922055710f4f 2023-09-23 15:04:33,088 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/.tmp/info/51056ff2311945c5bc0230e2c7025f1c 2023-09-23 15:04:33,092 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:04:33,092 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:04:33,092 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 15:04:33,092 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40421,1695481329420 2023-09-23 15:04:33,092 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 15:04:33,092 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 15:04:33,092 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 15:04:33,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2/.tmp/l/a8cd73ad318942a6a89d7242ad58a763 2023-09-23 15:04:33,093 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40421,1695481329420] 2023-09-23 15:04:33,094 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40421,1695481329420; numProcessing=1 2023-09-23 15:04:33,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035/.tmp/info/e24d8cb79c0d41048027922055710f4f as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035/info/e24d8cb79c0d41048027922055710f4f 2023-09-23 15:04:33,096 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51056ff2311945c5bc0230e2c7025f1c 2023-09-23 15:04:33,097 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40421,1695481329420 already deleted, retry=false 2023-09-23 15:04:33,097 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40421,1695481329420 expired; onlineServers=2 2023-09-23 15:04:33,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8cd73ad318942a6a89d7242ad58a763 2023-09-23 15:04:33,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2/.tmp/l/a8cd73ad318942a6a89d7242ad58a763 as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2/l/a8cd73ad318942a6a89d7242ad58a763 2023-09-23 15:04:33,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035/info/e24d8cb79c0d41048027922055710f4f, entries=2, sequenceid=6, filesize=4.8 K 2023-09-23 15:04:33,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4b8b659b076874d3607df57b2ada0035 in 51ms, sequenceid=6, compaction requested=false 2023-09-23 15:04:33,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8cd73ad318942a6a89d7242ad58a763 2023-09-23 15:04:33,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2/l/a8cd73ad318942a6a89d7242ad58a763, entries=7, sequenceid=18, filesize=5.2 K 2023-09-23 15:04:33,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for f60c13d8c45751bc6befef43bb40eff2 in 61ms, sequenceid=18, compaction requested=false 2023-09-23 15:04:33,117 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/.tmp/rep_barrier/aa60fe99036341d3a2d1bae342a4a130 2023-09-23 15:04:33,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/namespace/4b8b659b076874d3607df57b2ada0035/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 15:04:33,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:04:33,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. 2023-09-23 15:04:33,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4b8b659b076874d3607df57b2ada0035: 2023-09-23 15:04:33,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695481331687.4b8b659b076874d3607df57b2ada0035. 2023-09-23 15:04:33,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/acl/f60c13d8c45751bc6befef43bb40eff2/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-23 15:04:33,120 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-23 15:04:33,120 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-23 15:04:33,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:04:33,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. 2023-09-23 15:04:33,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f60c13d8c45751bc6befef43bb40eff2: 2023-09-23 15:04:33,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695481332435.f60c13d8c45751bc6befef43bb40eff2. 2023-09-23 15:04:33,122 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-23 15:04:33,122 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-23 15:04:33,123 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa60fe99036341d3a2d1bae342a4a130 2023-09-23 15:04:33,128 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-23 15:04:33,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/.tmp/table/ca337a9ef5f3431fa070237abce8d7e1 2023-09-23 15:04:33,138 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca337a9ef5f3431fa070237abce8d7e1 2023-09-23 15:04:33,139 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/.tmp/info/51056ff2311945c5bc0230e2c7025f1c as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/info/51056ff2311945c5bc0230e2c7025f1c 2023-09-23 15:04:33,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51056ff2311945c5bc0230e2c7025f1c 2023-09-23 15:04:33,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/info/51056ff2311945c5bc0230e2c7025f1c, entries=48, sequenceid=131, filesize=10.3 K 2023-09-23 15:04:33,145 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/.tmp/rep_barrier/aa60fe99036341d3a2d1bae342a4a130 as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/rep_barrier/aa60fe99036341d3a2d1bae342a4a130 2023-09-23 15:04:33,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa60fe99036341d3a2d1bae342a4a130 2023-09-23 15:04:33,151 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/rep_barrier/aa60fe99036341d3a2d1bae342a4a130, entries=13, sequenceid=131, filesize=6.4 K 2023-09-23 15:04:33,151 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/.tmp/table/ca337a9ef5f3431fa070237abce8d7e1 as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/table/ca337a9ef5f3431fa070237abce8d7e1 2023-09-23 15:04:33,156 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca337a9ef5f3431fa070237abce8d7e1 2023-09-23 15:04:33,156 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/table/ca337a9ef5f3431fa070237abce8d7e1, entries=24, sequenceid=131, filesize=6.9 K 2023-09-23 15:04:33,157 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 104ms, sequenceid=131, compaction requested=false 2023-09-23 15:04:33,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-23 15:04:33,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 15:04:33,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-23 15:04:33,169 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-23 15:04:33,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-23 15:04:33,169 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-23 15:04:33,173 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-23 15:04:33,173 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-23 15:04:33,193 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 15:04:33,194 INFO [RS:0;jenkins-hbase4:40421] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40421,1695481329420; zookeeper connection closed. 2023-09-23 15:04:33,194 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:40421-0x100d94f25c80001, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 15:04:33,194 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@10df8ef1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@10df8ef1 2023-09-23 15:04:33,252 INFO [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39421,1695481329509; all regions closed. 2023-09-23 15:04:33,252 INFO [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39755,1695481329466; all regions closed. 2023-09-23 15:04:33,261 DEBUG [RS:1;jenkins-hbase4:39755] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/oldWALs 2023-09-23 15:04:33,261 DEBUG [RS:2;jenkins-hbase4:39421] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/oldWALs 2023-09-23 15:04:33,261 INFO [RS:1;jenkins-hbase4:39755] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39755%2C1695481329466.meta:.meta(num 1695481331388) 2023-09-23 15:04:33,261 INFO [RS:2;jenkins-hbase4:39421] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39421%2C1695481329509:(num 1695481331262) 2023-09-23 15:04:33,262 DEBUG [RS:2;jenkins-hbase4:39421] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:04:33,262 INFO [RS:2;jenkins-hbase4:39421] regionserver.LeaseManager(133): Closed leases 2023-09-23 15:04:33,262 INFO [RS:2;jenkins-hbase4:39421] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-23 15:04:33,263 INFO [RS:2;jenkins-hbase4:39421] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-23 15:04:33,263 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 15:04:33,263 INFO [RS:2;jenkins-hbase4:39421] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-23 15:04:33,263 INFO [RS:2;jenkins-hbase4:39421] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-23 15:04:33,265 INFO [RS:2;jenkins-hbase4:39421] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39421 2023-09-23 15:04:33,267 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:04:33,267 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 15:04:33,267 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39421,1695481329509 2023-09-23 15:04:33,268 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39421,1695481329509] 2023-09-23 15:04:33,268 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39421,1695481329509; numProcessing=2 2023-09-23 15:04:33,269 DEBUG [RS:1;jenkins-hbase4:39755] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/oldWALs 2023-09-23 15:04:33,269 INFO [RS:1;jenkins-hbase4:39755] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39755%2C1695481329466:(num 1695481331262) 2023-09-23 15:04:33,269 DEBUG [RS:1;jenkins-hbase4:39755] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:04:33,269 INFO [RS:1;jenkins-hbase4:39755] regionserver.LeaseManager(133): Closed leases 2023-09-23 15:04:33,270 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39421,1695481329509 already deleted, retry=false 2023-09-23 15:04:33,270 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39421,1695481329509 expired; onlineServers=1 2023-09-23 15:04:33,270 INFO [RS:1;jenkins-hbase4:39755] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-23 15:04:33,270 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 15:04:33,271 INFO [RS:1;jenkins-hbase4:39755] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39755 2023-09-23 15:04:33,369 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 15:04:33,369 INFO [RS:2;jenkins-hbase4:39421] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39421,1695481329509; zookeeper connection closed. 2023-09-23 15:04:33,369 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39421-0x100d94f25c80003, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 15:04:33,369 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@356739e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@356739e 2023-09-23 15:04:33,371 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39755,1695481329466 2023-09-23 15:04:33,371 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 15:04:33,373 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39755,1695481329466] 2023-09-23 15:04:33,373 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39755,1695481329466; numProcessing=3 2023-09-23 15:04:33,374 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39755,1695481329466 already deleted, retry=false 2023-09-23 15:04:33,374 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39755,1695481329466 expired; onlineServers=0 2023-09-23 15:04:33,374 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40555,1695481328153' ***** 2023-09-23 15:04:33,374 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-23 15:04:33,374 DEBUG [M:0;jenkins-hbase4:40555] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23eb1d8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-23 15:04:33,375 INFO [M:0;jenkins-hbase4:40555] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40555,1695481328153 2023-09-23 15:04:33,375 INFO [M:0;jenkins-hbase4:40555] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40555,1695481328153; all regions closed. 2023-09-23 15:04:33,375 DEBUG [M:0;jenkins-hbase4:40555] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 15:04:33,375 DEBUG [M:0;jenkins-hbase4:40555] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-23 15:04:33,375 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-23 15:04:33,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695481330870] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695481330870,5,FailOnTimeoutGroup] 2023-09-23 15:04:33,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695481330866] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695481330866,5,FailOnTimeoutGroup] 2023-09-23 15:04:33,375 DEBUG [M:0;jenkins-hbase4:40555] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-23 15:04:33,375 INFO [M:0;jenkins-hbase4:40555] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-23 15:04:33,375 INFO [M:0;jenkins-hbase4:40555] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-23 15:04:33,375 INFO [M:0;jenkins-hbase4:40555] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-23 15:04:33,375 DEBUG [M:0;jenkins-hbase4:40555] master.HMaster(1512): Stopping service threads 2023-09-23 15:04:33,376 INFO [M:0;jenkins-hbase4:40555] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-23 15:04:33,376 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-23 15:04:33,376 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 15:04:33,376 ERROR [M:0;jenkins-hbase4:40555] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-23 15:04:33,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 15:04:33,377 INFO [M:0;jenkins-hbase4:40555] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-23 15:04:33,377 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-23 15:04:33,377 DEBUG [M:0;jenkins-hbase4:40555] zookeeper.ZKUtil(398): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-23 15:04:33,377 WARN [M:0;jenkins-hbase4:40555] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-23 15:04:33,377 INFO [M:0;jenkins-hbase4:40555] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-23 15:04:33,378 INFO [M:0;jenkins-hbase4:40555] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-23 15:04:33,378 DEBUG [M:0;jenkins-hbase4:40555] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-23 15:04:33,378 INFO [M:0;jenkins-hbase4:40555] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 15:04:33,379 DEBUG [M:0;jenkins-hbase4:40555] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 15:04:33,379 DEBUG [M:0;jenkins-hbase4:40555] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-23 15:04:33,379 DEBUG [M:0;jenkins-hbase4:40555] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 15:04:33,379 INFO [M:0;jenkins-hbase4:40555] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.67 KB heapSize=451.92 KB 2023-09-23 15:04:33,393 INFO [M:0;jenkins-hbase4:40555] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.67 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ce3e0c8f178249e58180fd4185e66a6a 2023-09-23 15:04:33,396 INFO [M:0;jenkins-hbase4:40555] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce3e0c8f178249e58180fd4185e66a6a 2023-09-23 15:04:33,397 DEBUG [M:0;jenkins-hbase4:40555] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ce3e0c8f178249e58180fd4185e66a6a as hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ce3e0c8f178249e58180fd4185e66a6a 2023-09-23 15:04:33,401 INFO [M:0;jenkins-hbase4:40555] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce3e0c8f178249e58180fd4185e66a6a 2023-09-23 15:04:33,401 INFO [M:0;jenkins-hbase4:40555] regionserver.HStore(1080): Added hdfs://localhost:35975/user/jenkins/test-data/499880ce-5fea-e3ec-416f-e87495749fc8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ce3e0c8f178249e58180fd4185e66a6a, entries=119, sequenceid=899, filesize=28.6 K 2023-09-23 15:04:33,402 INFO [M:0;jenkins-hbase4:40555] regionserver.HRegion(2948): Finished flush of dataSize ~375.67 KB/384687, heapSize ~451.91 KB/462752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-09-23 15:04:33,404 INFO [M:0;jenkins-hbase4:40555] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 15:04:33,404 DEBUG [M:0;jenkins-hbase4:40555] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-23 15:04:33,407 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 15:04:33,407 INFO [M:0;jenkins-hbase4:40555] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-23 15:04:33,407 INFO [M:0;jenkins-hbase4:40555] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40555 2023-09-23 15:04:33,410 DEBUG [M:0;jenkins-hbase4:40555] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40555,1695481328153 already deleted, retry=false 2023-09-23 15:04:33,473 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 15:04:33,473 INFO [RS:1;jenkins-hbase4:39755] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39755,1695481329466; zookeeper connection closed. 2023-09-23 15:04:33,473 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): regionserver:39755-0x100d94f25c80002, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 15:04:33,473 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7997a631] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7997a631 2023-09-23 15:04:33,473 INFO [Listener at jenkins-hbase4.apache.org/46353] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-23 15:04:33,573 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 15:04:33,573 DEBUG [Listener at localhost/35841-EventThread] zookeeper.ZKWatcher(600): master:40555-0x100d94f25c80000, quorum=127.0.0.1:55260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 15:04:33,573 INFO [M:0;jenkins-hbase4:40555] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40555,1695481328153; zookeeper connection closed. 2023-09-23 15:04:33,575 WARN [Listener at jenkins-hbase4.apache.org/46353] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-23 15:04:33,578 INFO [Listener at jenkins-hbase4.apache.org/46353] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 15:04:33,681 WARN [BP-567156051-172.31.14.131-1695481324212 heartbeating to localhost/127.0.0.1:35975] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-23 15:04:33,681 WARN [BP-567156051-172.31.14.131-1695481324212 heartbeating to localhost/127.0.0.1:35975] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-567156051-172.31.14.131-1695481324212 (Datanode Uuid caed5075-6d05-4fc6-88bc-f87c43fa75b7) service to localhost/127.0.0.1:35975 2023-09-23 15:04:33,683 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/dfs/data/data5/current/BP-567156051-172.31.14.131-1695481324212] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 15:04:33,683 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/dfs/data/data6/current/BP-567156051-172.31.14.131-1695481324212] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 15:04:33,685 WARN [Listener at jenkins-hbase4.apache.org/46353] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-23 15:04:33,688 INFO [Listener at jenkins-hbase4.apache.org/46353] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 15:04:33,791 WARN [BP-567156051-172.31.14.131-1695481324212 heartbeating to localhost/127.0.0.1:35975] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-23 15:04:33,791 WARN [BP-567156051-172.31.14.131-1695481324212 heartbeating to localhost/127.0.0.1:35975] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-567156051-172.31.14.131-1695481324212 (Datanode Uuid 07bc4283-0ba3-4e68-9c7b-d8753d4bdd9a) service to localhost/127.0.0.1:35975 2023-09-23 15:04:33,792 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/dfs/data/data3/current/BP-567156051-172.31.14.131-1695481324212] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 15:04:33,792 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/dfs/data/data4/current/BP-567156051-172.31.14.131-1695481324212] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 15:04:33,793 WARN [Listener at jenkins-hbase4.apache.org/46353] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-23 15:04:33,795 INFO [Listener at jenkins-hbase4.apache.org/46353] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 15:04:33,898 WARN [BP-567156051-172.31.14.131-1695481324212 heartbeating to localhost/127.0.0.1:35975] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-23 15:04:33,898 WARN [BP-567156051-172.31.14.131-1695481324212 heartbeating to localhost/127.0.0.1:35975] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-567156051-172.31.14.131-1695481324212 (Datanode Uuid 86b8c583-c178-4390-9b3f-8ff4abacec3c) service to localhost/127.0.0.1:35975 2023-09-23 15:04:33,899 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/dfs/data/data1/current/BP-567156051-172.31.14.131-1695481324212] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 15:04:33,899 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7e15e371-1ef7-e966-b196-c19909264109/cluster_11fc9f09-1f1f-ee6f-c69e-d6176876f7de/dfs/data/data2/current/BP-567156051-172.31.14.131-1695481324212] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 15:04:33,922 INFO [Listener at jenkins-hbase4.apache.org/46353] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 15:04:34,049 INFO [Listener at jenkins-hbase4.apache.org/46353] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-23 15:04:34,151 INFO [Listener at jenkins-hbase4.apache.org/46353] hbase.HBaseTestingUtility(1293): Minicluster is down