2023-07-16 01:10:58,547 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-16 01:10:58,819 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b 2023-07-16 01:10:58,819 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-16 01:10:58,864 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-16 01:10:59,163 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-16 01:10:59,164 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9, deleteOnExit=true 2023-07-16 01:10:59,164 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-16 01:10:59,165 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/test.cache.data in system properties and HBase conf 2023-07-16 01:10:59,166 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 01:10:59,166 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop.log.dir in system properties and HBase conf 2023-07-16 01:10:59,167 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 01:10:59,167 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 01:10:59,168 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 01:10:59,585 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-16 01:10:59,592 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 01:10:59,592 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 01:10:59,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 01:10:59,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 01:10:59,593 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 01:10:59,594 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 01:10:59,594 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 01:10:59,595 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 01:10:59,595 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 01:10:59,596 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/nfs.dump.dir in system properties and HBase conf 2023-07-16 01:10:59,596 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/java.io.tmpdir in system properties and HBase conf 2023-07-16 01:10:59,597 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 01:10:59,597 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 01:10:59,597 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-16 01:11:00,264 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 01:11:00,269 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 01:11:00,640 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-16 01:11:00,878 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-16 01:11:00,894 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:00,940 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:00,988 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/java.io.tmpdir/Jetty_localhost_42555_hdfs____in9kw1/webapp 2023-07-16 01:11:01,209 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42555 2023-07-16 01:11:01,220 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 01:11:01,220 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 01:11:01,806 WARN [Listener at localhost/40869] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 01:11:01,899 WARN [Listener at localhost/40869] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 01:11:01,937 WARN [Listener at localhost/40869] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:01,948 INFO [Listener at localhost/40869] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:02,023 INFO [Listener at localhost/40869] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/java.io.tmpdir/Jetty_localhost_40931_datanode____.5hyvjy/webapp 2023-07-16 01:11:02,131 INFO [Listener at localhost/40869] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40931 2023-07-16 01:11:02,682 WARN [Listener at localhost/38573] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 01:11:02,720 WARN [Listener at localhost/38573] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 01:11:02,726 WARN [Listener at localhost/38573] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:02,728 INFO [Listener at localhost/38573] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:02,741 INFO [Listener at localhost/38573] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/java.io.tmpdir/Jetty_localhost_35351_datanode____.nbhl4c/webapp 2023-07-16 01:11:02,875 INFO [Listener at localhost/38573] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35351 2023-07-16 01:11:02,902 WARN [Listener at localhost/44125] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 01:11:02,949 WARN [Listener at localhost/44125] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 01:11:02,953 WARN [Listener at localhost/44125] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:02,955 INFO [Listener at localhost/44125] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:02,965 INFO [Listener at localhost/44125] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/java.io.tmpdir/Jetty_localhost_40075_datanode____1dqnll/webapp 2023-07-16 01:11:03,101 INFO [Listener at localhost/44125] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40075 2023-07-16 01:11:03,126 WARN [Listener at localhost/33183] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 01:11:03,470 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x71468c948a832c80: Processing first storage report for DS-3bd37f57-393f-4fde-a060-52a570ae8dc7 from datanode a8962899-e062-45d7-9d32-941072eb2f03 2023-07-16 01:11:03,472 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x71468c948a832c80: from storage DS-3bd37f57-393f-4fde-a060-52a570ae8dc7 node DatanodeRegistration(127.0.0.1:41135, datanodeUuid=a8962899-e062-45d7-9d32-941072eb2f03, infoPort=42273, infoSecurePort=0, ipcPort=33183, storageInfo=lv=-57;cid=testClusterID;nsid=1903997412;c=1689469860362), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-16 01:11:03,472 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3770ff74cfcb920f: Processing first storage report for DS-b579dd2d-1b32-4757-bca5-808c3128c6cc from datanode 187cf807-9cbb-43d8-b085-99b26a17cfcd 2023-07-16 01:11:03,472 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3770ff74cfcb920f: from storage DS-b579dd2d-1b32-4757-bca5-808c3128c6cc node DatanodeRegistration(127.0.0.1:41981, datanodeUuid=187cf807-9cbb-43d8-b085-99b26a17cfcd, infoPort=44737, infoSecurePort=0, ipcPort=38573, storageInfo=lv=-57;cid=testClusterID;nsid=1903997412;c=1689469860362), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 01:11:03,473 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x23799ef1667c24f3: Processing first storage report for DS-cd83b92f-a5fc-493f-8a8d-e55137dc5272 from datanode 88d35cd8-1f10-4ebb-8af2-128649e2b955 2023-07-16 01:11:03,473 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x23799ef1667c24f3: from storage DS-cd83b92f-a5fc-493f-8a8d-e55137dc5272 node DatanodeRegistration(127.0.0.1:34573, datanodeUuid=88d35cd8-1f10-4ebb-8af2-128649e2b955, infoPort=35571, infoSecurePort=0, ipcPort=44125, storageInfo=lv=-57;cid=testClusterID;nsid=1903997412;c=1689469860362), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 01:11:03,473 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x71468c948a832c80: Processing first storage report for DS-a472a0f6-cb13-49e1-9017-a4840b7e5407 from datanode a8962899-e062-45d7-9d32-941072eb2f03 2023-07-16 01:11:03,473 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x71468c948a832c80: from storage DS-a472a0f6-cb13-49e1-9017-a4840b7e5407 node DatanodeRegistration(127.0.0.1:41135, datanodeUuid=a8962899-e062-45d7-9d32-941072eb2f03, infoPort=42273, infoSecurePort=0, ipcPort=33183, storageInfo=lv=-57;cid=testClusterID;nsid=1903997412;c=1689469860362), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 01:11:03,473 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3770ff74cfcb920f: Processing first storage report for DS-fd317493-3ca6-47b0-a76a-87a557255930 from datanode 187cf807-9cbb-43d8-b085-99b26a17cfcd 2023-07-16 01:11:03,473 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3770ff74cfcb920f: from storage DS-fd317493-3ca6-47b0-a76a-87a557255930 node DatanodeRegistration(127.0.0.1:41981, datanodeUuid=187cf807-9cbb-43d8-b085-99b26a17cfcd, infoPort=44737, infoSecurePort=0, ipcPort=38573, storageInfo=lv=-57;cid=testClusterID;nsid=1903997412;c=1689469860362), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 01:11:03,473 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x23799ef1667c24f3: Processing first storage report for DS-686de176-3f4a-4899-ba42-9866368245c0 from datanode 88d35cd8-1f10-4ebb-8af2-128649e2b955 2023-07-16 01:11:03,473 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x23799ef1667c24f3: from storage DS-686de176-3f4a-4899-ba42-9866368245c0 node DatanodeRegistration(127.0.0.1:34573, datanodeUuid=88d35cd8-1f10-4ebb-8af2-128649e2b955, infoPort=35571, infoSecurePort=0, ipcPort=44125, storageInfo=lv=-57;cid=testClusterID;nsid=1903997412;c=1689469860362), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 01:11:03,712 DEBUG [Listener at localhost/33183] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b 2023-07-16 01:11:03,826 INFO [Listener at localhost/33183] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/zookeeper_0, clientPort=64468, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-16 01:11:03,851 INFO [Listener at localhost/33183] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64468 2023-07-16 01:11:03,864 INFO [Listener at localhost/33183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:03,867 INFO [Listener at localhost/33183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:04,616 INFO [Listener at localhost/33183] util.FSUtils(471): Created version file at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 with version=8 2023-07-16 01:11:04,616 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/hbase-staging 2023-07-16 01:11:05,018 INFO [Listener at localhost/33183] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-16 01:11:05,645 INFO [Listener at localhost/33183] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 01:11:05,697 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:05,698 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:05,698 INFO [Listener at localhost/33183] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 01:11:05,698 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:05,698 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 01:11:05,899 INFO [Listener at localhost/33183] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 01:11:06,001 DEBUG [Listener at localhost/33183] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-16 01:11:06,117 INFO [Listener at localhost/33183] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39271 2023-07-16 01:11:06,134 INFO [Listener at localhost/33183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,137 INFO [Listener at localhost/33183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,169 INFO [Listener at localhost/33183] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39271 connecting to ZooKeeper ensemble=127.0.0.1:64468 2023-07-16 01:11:06,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:392710x0, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 01:11:06,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39271-0x1016baeca7e0000 connected 2023-07-16 01:11:06,300 DEBUG [Listener at localhost/33183] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 01:11:06,301 DEBUG [Listener at localhost/33183] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:11:06,319 DEBUG [Listener at localhost/33183] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 01:11:06,334 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39271 2023-07-16 01:11:06,336 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39271 2023-07-16 01:11:06,337 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39271 2023-07-16 01:11:06,339 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39271 2023-07-16 01:11:06,340 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39271 2023-07-16 01:11:06,349 INFO [Listener at localhost/33183] master.HMaster(444): hbase.rootdir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5, hbase.cluster.distributed=false 2023-07-16 01:11:06,446 INFO [Listener at localhost/33183] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 01:11:06,447 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,447 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,447 INFO [Listener at localhost/33183] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 01:11:06,447 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,447 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 01:11:06,452 INFO [Listener at localhost/33183] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 01:11:06,455 INFO [Listener at localhost/33183] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39681 2023-07-16 01:11:06,458 INFO [Listener at localhost/33183] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 01:11:06,468 DEBUG [Listener at localhost/33183] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-16 01:11:06,469 INFO [Listener at localhost/33183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,472 INFO [Listener at localhost/33183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,474 INFO [Listener at localhost/33183] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39681 connecting to ZooKeeper ensemble=127.0.0.1:64468 2023-07-16 01:11:06,484 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:396810x0, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 01:11:06,486 DEBUG [Listener at localhost/33183] zookeeper.ZKUtil(164): regionserver:396810x0, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 01:11:06,488 DEBUG [Listener at localhost/33183] zookeeper.ZKUtil(164): regionserver:396810x0, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:11:06,489 DEBUG [Listener at localhost/33183] zookeeper.ZKUtil(164): regionserver:396810x0, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 01:11:06,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39681-0x1016baeca7e0001 connected 2023-07-16 01:11:06,494 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39681 2023-07-16 01:11:06,495 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39681 2023-07-16 01:11:06,499 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39681 2023-07-16 01:11:06,502 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39681 2023-07-16 01:11:06,502 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39681 2023-07-16 01:11:06,516 INFO [Listener at localhost/33183] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 01:11:06,517 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,517 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,517 INFO [Listener at localhost/33183] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 01:11:06,518 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,518 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 01:11:06,518 INFO [Listener at localhost/33183] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 01:11:06,520 INFO [Listener at localhost/33183] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45775 2023-07-16 01:11:06,521 INFO [Listener at localhost/33183] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 01:11:06,523 DEBUG [Listener at localhost/33183] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-16 01:11:06,524 INFO [Listener at localhost/33183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,527 INFO [Listener at localhost/33183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,531 INFO [Listener at localhost/33183] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45775 connecting to ZooKeeper ensemble=127.0.0.1:64468 2023-07-16 01:11:06,538 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:457750x0, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 01:11:06,539 DEBUG [Listener at localhost/33183] zookeeper.ZKUtil(164): regionserver:457750x0, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 01:11:06,540 DEBUG [Listener at localhost/33183] zookeeper.ZKUtil(164): regionserver:457750x0, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:11:06,541 DEBUG [Listener at localhost/33183] zookeeper.ZKUtil(164): regionserver:457750x0, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 01:11:06,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45775-0x1016baeca7e0002 connected 2023-07-16 01:11:06,546 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45775 2023-07-16 01:11:06,550 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45775 2023-07-16 01:11:06,553 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45775 2023-07-16 01:11:06,559 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45775 2023-07-16 01:11:06,560 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45775 2023-07-16 01:11:06,572 INFO [Listener at localhost/33183] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 01:11:06,572 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,572 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,573 INFO [Listener at localhost/33183] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 01:11:06,573 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 01:11:06,573 INFO [Listener at localhost/33183] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 01:11:06,573 INFO [Listener at localhost/33183] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 01:11:06,579 INFO [Listener at localhost/33183] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41029 2023-07-16 01:11:06,579 INFO [Listener at localhost/33183] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 01:11:06,581 DEBUG [Listener at localhost/33183] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-16 01:11:06,582 INFO [Listener at localhost/33183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,584 INFO [Listener at localhost/33183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,585 INFO [Listener at localhost/33183] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41029 connecting to ZooKeeper ensemble=127.0.0.1:64468 2023-07-16 01:11:06,590 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:410290x0, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 01:11:06,592 DEBUG [Listener at localhost/33183] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 01:11:06,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41029-0x1016baeca7e0003 connected 2023-07-16 01:11:06,592 DEBUG [Listener at localhost/33183] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:11:06,593 DEBUG [Listener at localhost/33183] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 01:11:06,594 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41029 2023-07-16 01:11:06,598 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41029 2023-07-16 01:11:06,598 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41029 2023-07-16 01:11:06,602 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41029 2023-07-16 01:11:06,602 DEBUG [Listener at localhost/33183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41029 2023-07-16 01:11:06,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39271,1689469864817 2023-07-16 01:11:06,613 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 01:11:06,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39271,1689469864817 2023-07-16 01:11:06,640 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 01:11:06,640 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 01:11:06,640 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 01:11:06,640 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 01:11:06,640 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:06,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 01:11:06,644 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 01:11:06,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39271,1689469864817 from backup master directory 2023-07-16 01:11:06,651 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39271,1689469864817 2023-07-16 01:11:06,651 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 01:11:06,652 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 01:11:06,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39271,1689469864817 2023-07-16 01:11:06,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-16 01:11:06,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-16 01:11:06,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/hbase.id with ID: 054ac35a-5120-4984-9a33-a303de3708c6 2023-07-16 01:11:06,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 01:11:06,865 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:06,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x36ab921d to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:06,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@105c1880, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:07,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 01:11:07,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-16 01:11:07,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-16 01:11:07,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-16 01:11:07,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 01:11:07,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 01:11:07,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 01:11:07,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/data/master/store-tmp 2023-07-16 01:11:07,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:07,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 01:11:07,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:11:07,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:11:07,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 01:11:07,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:11:07,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:11:07,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 01:11:07,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/WALs/jenkins-hbase4.apache.org,39271,1689469864817 2023-07-16 01:11:07,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39271%2C1689469864817, suffix=, logDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/WALs/jenkins-hbase4.apache.org,39271,1689469864817, archiveDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/oldWALs, maxLogs=10 2023-07-16 01:11:07,240 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34573,DS-cd83b92f-a5fc-493f-8a8d-e55137dc5272,DISK] 2023-07-16 01:11:07,240 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41135,DS-3bd37f57-393f-4fde-a060-52a570ae8dc7,DISK] 2023-07-16 01:11:07,240 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41981,DS-b579dd2d-1b32-4757-bca5-808c3128c6cc,DISK] 2023-07-16 01:11:07,250 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-16 01:11:07,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/WALs/jenkins-hbase4.apache.org,39271,1689469864817/jenkins-hbase4.apache.org%2C39271%2C1689469864817.1689469867176 2023-07-16 01:11:07,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41135,DS-3bd37f57-393f-4fde-a060-52a570ae8dc7,DISK], DatanodeInfoWithStorage[127.0.0.1:34573,DS-cd83b92f-a5fc-493f-8a8d-e55137dc5272,DISK], DatanodeInfoWithStorage[127.0.0.1:41981,DS-b579dd2d-1b32-4757-bca5-808c3128c6cc,DISK]] 2023-07-16 01:11:07,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-16 01:11:07,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:07,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 01:11:07,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 01:11:07,428 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-16 01:11:07,437 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-16 01:11:07,475 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-16 01:11:07,491 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:07,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 01:11:07,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 01:11:07,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 01:11:07,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:07,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66418261, jitterRate=-0.010290786623954773}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:07,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 01:11:07,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-16 01:11:07,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-16 01:11:07,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-16 01:11:07,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-16 01:11:07,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-16 01:11:07,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 51 msec 2023-07-16 01:11:07,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-16 01:11:07,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-16 01:11:07,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-16 01:11:07,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-16 01:11:07,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-16 01:11:07,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-16 01:11:07,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-16 01:11:07,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-16 01:11:07,722 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:07,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-16 01:11:07,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-16 01:11:07,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-16 01:11:07,748 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 01:11:07,748 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 01:11:07,748 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 01:11:07,748 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 01:11:07,749 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:07,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39271,1689469864817, sessionid=0x1016baeca7e0000, setting cluster-up flag (Was=false) 2023-07-16 01:11:07,774 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:07,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-16 01:11:07,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39271,1689469864817 2023-07-16 01:11:07,793 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:07,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-16 01:11:07,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39271,1689469864817 2023-07-16 01:11:07,805 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp 2023-07-16 01:11:07,929 INFO [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(951): ClusterId : 054ac35a-5120-4984-9a33-a303de3708c6 2023-07-16 01:11:07,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-16 01:11:07,962 INFO [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(951): ClusterId : 054ac35a-5120-4984-9a33-a303de3708c6 2023-07-16 01:11:07,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:07,941 INFO [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(951): ClusterId : 054ac35a-5120-4984-9a33-a303de3708c6 2023-07-16 01:11:07,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-16 01:11:07,970 DEBUG [RS:0;jenkins-hbase4:39681] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 01:11:07,971 DEBUG [RS:1;jenkins-hbase4:45775] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 01:11:07,973 DEBUG [RS:2;jenkins-hbase4:41029] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 01:11:07,980 DEBUG [RS:2;jenkins-hbase4:41029] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 01:11:07,980 DEBUG [RS:2;jenkins-hbase4:41029] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 01:11:07,981 DEBUG [RS:0;jenkins-hbase4:39681] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 01:11:07,982 DEBUG [RS:0;jenkins-hbase4:39681] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 01:11:07,981 DEBUG [RS:1;jenkins-hbase4:45775] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 01:11:07,982 DEBUG [RS:1;jenkins-hbase4:45775] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 01:11:07,991 DEBUG [RS:2;jenkins-hbase4:41029] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 01:11:07,993 DEBUG [RS:1;jenkins-hbase4:45775] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 01:11:07,993 DEBUG [RS:2;jenkins-hbase4:41029] zookeeper.ReadOnlyZKClient(139): Connect 0x47ff91de to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:07,994 DEBUG [RS:1;jenkins-hbase4:45775] zookeeper.ReadOnlyZKClient(139): Connect 0x588b8164 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:08,002 DEBUG [RS:0;jenkins-hbase4:39681] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 01:11:08,008 DEBUG [RS:0;jenkins-hbase4:39681] zookeeper.ReadOnlyZKClient(139): Connect 0x1f3cb92c to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:08,067 DEBUG [RS:2;jenkins-hbase4:41029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49386751, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:08,068 DEBUG [RS:2;jenkins-hbase4:41029] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d07faae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 01:11:08,070 DEBUG [RS:1;jenkins-hbase4:45775] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@564c6405, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:08,070 DEBUG [RS:1;jenkins-hbase4:45775] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5273ea14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 01:11:08,086 DEBUG [RS:0;jenkins-hbase4:39681] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11fb44bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:08,086 DEBUG [RS:0;jenkins-hbase4:39681] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50c64e80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 01:11:08,110 DEBUG [RS:1;jenkins-hbase4:45775] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45775 2023-07-16 01:11:08,112 DEBUG [RS:0;jenkins-hbase4:39681] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39681 2023-07-16 01:11:08,113 DEBUG [RS:2;jenkins-hbase4:41029] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:41029 2023-07-16 01:11:08,118 INFO [RS:2;jenkins-hbase4:41029] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 01:11:08,119 INFO [RS:2;jenkins-hbase4:41029] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 01:11:08,119 DEBUG [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 01:11:08,119 INFO [RS:0;jenkins-hbase4:39681] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 01:11:08,120 INFO [RS:0;jenkins-hbase4:39681] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 01:11:08,120 DEBUG [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 01:11:08,121 INFO [RS:0;jenkins-hbase4:39681] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:08,123 DEBUG [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 01:11:08,118 INFO [RS:1;jenkins-hbase4:45775] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 01:11:08,123 INFO [RS:1;jenkins-hbase4:45775] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 01:11:08,123 DEBUG [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 01:11:08,123 INFO [RS:1;jenkins-hbase4:45775] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:08,126 INFO [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39271,1689469864817 with isa=jenkins-hbase4.apache.org/172.31.14.131:39681, startcode=1689469866446 2023-07-16 01:11:08,126 INFO [RS:2;jenkins-hbase4:41029] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:08,126 DEBUG [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 01:11:08,127 INFO [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39271,1689469864817 with isa=jenkins-hbase4.apache.org/172.31.14.131:41029, startcode=1689469866571 2023-07-16 01:11:08,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-16 01:11:08,131 DEBUG [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 01:11:08,132 INFO [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39271,1689469864817 with isa=jenkins-hbase4.apache.org/172.31.14.131:45775, startcode=1689469866515 2023-07-16 01:11:08,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 01:11:08,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 01:11:08,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 01:11:08,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 01:11:08,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-16 01:11:08,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 01:11:08,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,153 DEBUG [RS:2;jenkins-hbase4:41029] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 01:11:08,153 DEBUG [RS:0;jenkins-hbase4:39681] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 01:11:08,153 DEBUG [RS:1;jenkins-hbase4:45775] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 01:11:08,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689469898173 2023-07-16 01:11:08,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-16 01:11:08,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-16 01:11:08,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-16 01:11:08,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-16 01:11:08,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-16 01:11:08,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-16 01:11:08,229 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 01:11:08,230 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-16 01:11:08,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,253 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 01:11:08,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-16 01:11:08,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-16 01:11:08,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-16 01:11:08,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-16 01:11:08,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-16 01:11:08,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689469868294,5,FailOnTimeoutGroup] 2023-07-16 01:11:08,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689469868299,5,FailOnTimeoutGroup] 2023-07-16 01:11:08,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-16 01:11:08,302 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52887, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 01:11:08,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,302 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42177, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 01:11:08,302 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44485, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 01:11:08,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,344 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39271] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:08,380 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:08,381 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:08,381 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:11:08,388 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39271] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:08,388 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39271] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:08,405 DEBUG [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:11:08,406 DEBUG [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40869 2023-07-16 01:11:08,406 DEBUG [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 01:11:08,406 DEBUG [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:11:08,408 DEBUG [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40869 2023-07-16 01:11:08,408 DEBUG [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 01:11:08,411 DEBUG [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:11:08,411 DEBUG [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40869 2023-07-16 01:11:08,411 DEBUG [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 01:11:08,425 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:11:08,426 DEBUG [RS:0;jenkins-hbase4:39681] zookeeper.ZKUtil(162): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:08,426 DEBUG [RS:2;jenkins-hbase4:41029] zookeeper.ZKUtil(162): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:08,426 DEBUG [RS:1;jenkins-hbase4:45775] zookeeper.ZKUtil(162): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:08,427 WARN [RS:0;jenkins-hbase4:39681] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 01:11:08,434 INFO [RS:0;jenkins-hbase4:39681] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 01:11:08,435 DEBUG [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/WALs/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:08,427 WARN [RS:2;jenkins-hbase4:41029] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 01:11:08,427 WARN [RS:1;jenkins-hbase4:45775] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 01:11:08,436 INFO [RS:1;jenkins-hbase4:45775] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 01:11:08,436 INFO [RS:2;jenkins-hbase4:41029] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 01:11:08,439 DEBUG [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/WALs/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:08,439 DEBUG [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/WALs/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:08,440 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45775,1689469866515] 2023-07-16 01:11:08,440 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39681,1689469866446] 2023-07-16 01:11:08,440 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41029,1689469866571] 2023-07-16 01:11:08,469 DEBUG [RS:0;jenkins-hbase4:39681] zookeeper.ZKUtil(162): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:08,470 DEBUG [RS:0;jenkins-hbase4:39681] zookeeper.ZKUtil(162): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:08,473 DEBUG [RS:0;jenkins-hbase4:39681] zookeeper.ZKUtil(162): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:08,478 DEBUG [RS:2;jenkins-hbase4:41029] zookeeper.ZKUtil(162): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:08,478 DEBUG [RS:1;jenkins-hbase4:45775] zookeeper.ZKUtil(162): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:08,479 DEBUG [RS:2;jenkins-hbase4:41029] zookeeper.ZKUtil(162): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:08,479 DEBUG [RS:2;jenkins-hbase4:41029] zookeeper.ZKUtil(162): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:08,480 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:08,481 DEBUG [RS:1;jenkins-hbase4:45775] zookeeper.ZKUtil(162): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:08,481 DEBUG [RS:1;jenkins-hbase4:45775] zookeeper.ZKUtil(162): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:08,483 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 01:11:08,486 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/info 2023-07-16 01:11:08,487 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 01:11:08,488 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:08,488 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 01:11:08,494 DEBUG [RS:1;jenkins-hbase4:45775] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 01:11:08,494 DEBUG [RS:0;jenkins-hbase4:39681] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 01:11:08,494 DEBUG [RS:2;jenkins-hbase4:41029] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 01:11:08,500 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/rep_barrier 2023-07-16 01:11:08,501 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 01:11:08,502 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:08,502 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 01:11:08,505 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/table 2023-07-16 01:11:08,506 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 01:11:08,507 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:08,507 INFO [RS:0;jenkins-hbase4:39681] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 01:11:08,507 INFO [RS:2;jenkins-hbase4:41029] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 01:11:08,508 INFO [RS:1;jenkins-hbase4:45775] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 01:11:08,512 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740 2023-07-16 01:11:08,513 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740 2023-07-16 01:11:08,518 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 01:11:08,520 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 01:11:08,523 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:08,524 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60241207, jitterRate=-0.10233606398105621}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 01:11:08,524 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 01:11:08,524 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 01:11:08,524 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 01:11:08,524 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 01:11:08,524 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 01:11:08,524 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 01:11:08,526 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 01:11:08,526 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 01:11:08,541 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 01:11:08,542 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-16 01:11:08,560 INFO [RS:2;jenkins-hbase4:41029] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 01:11:08,562 INFO [RS:1;jenkins-hbase4:45775] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 01:11:08,560 INFO [RS:0;jenkins-hbase4:39681] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 01:11:08,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-16 01:11:08,575 INFO [RS:1;jenkins-hbase4:45775] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 01:11:08,575 INFO [RS:1;jenkins-hbase4:45775] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,576 INFO [RS:2;jenkins-hbase4:41029] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 01:11:08,576 INFO [RS:0;jenkins-hbase4:39681] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 01:11:08,581 INFO [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 01:11:08,576 INFO [RS:2;jenkins-hbase4:41029] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,581 INFO [RS:0;jenkins-hbase4:39681] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,585 INFO [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 01:11:08,593 INFO [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 01:11:08,600 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-16 01:11:08,603 INFO [RS:0;jenkins-hbase4:39681] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,603 INFO [RS:1;jenkins-hbase4:45775] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,603 DEBUG [RS:0;jenkins-hbase4:39681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,603 DEBUG [RS:0;jenkins-hbase4:39681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,604 DEBUG [RS:0;jenkins-hbase4:39681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,604 INFO [RS:2;jenkins-hbase4:41029] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,604 DEBUG [RS:0;jenkins-hbase4:39681] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,604 DEBUG [RS:0;jenkins-hbase4:39681] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,604 DEBUG [RS:0;jenkins-hbase4:39681] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 01:11:08,604 DEBUG [RS:0;jenkins-hbase4:39681] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,604 DEBUG [RS:0;jenkins-hbase4:39681] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,605 DEBUG [RS:0;jenkins-hbase4:39681] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,605 DEBUG [RS:0;jenkins-hbase4:39681] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,605 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-16 01:11:08,606 INFO [RS:0;jenkins-hbase4:39681] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,606 INFO [RS:0;jenkins-hbase4:39681] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,606 INFO [RS:0;jenkins-hbase4:39681] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,603 DEBUG [RS:1;jenkins-hbase4:45775] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,604 DEBUG [RS:2;jenkins-hbase4:41029] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,609 DEBUG [RS:1;jenkins-hbase4:45775] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,609 DEBUG [RS:2;jenkins-hbase4:41029] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,610 DEBUG [RS:2;jenkins-hbase4:41029] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,610 DEBUG [RS:1;jenkins-hbase4:45775] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,611 DEBUG [RS:2;jenkins-hbase4:41029] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,611 DEBUG [RS:1;jenkins-hbase4:45775] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,611 DEBUG [RS:2;jenkins-hbase4:41029] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,611 DEBUG [RS:1;jenkins-hbase4:45775] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,611 DEBUG [RS:2;jenkins-hbase4:41029] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 01:11:08,611 DEBUG [RS:1;jenkins-hbase4:45775] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 01:11:08,611 DEBUG [RS:2;jenkins-hbase4:41029] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,611 DEBUG [RS:1;jenkins-hbase4:45775] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,611 DEBUG [RS:2;jenkins-hbase4:41029] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,611 DEBUG [RS:1;jenkins-hbase4:45775] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,611 DEBUG [RS:2;jenkins-hbase4:41029] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,612 DEBUG [RS:1;jenkins-hbase4:45775] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,612 DEBUG [RS:2;jenkins-hbase4:41029] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,612 DEBUG [RS:1;jenkins-hbase4:45775] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 01:11:08,622 INFO [RS:2;jenkins-hbase4:41029] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,622 INFO [RS:2;jenkins-hbase4:41029] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,623 INFO [RS:2;jenkins-hbase4:41029] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,625 INFO [RS:0;jenkins-hbase4:39681] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 01:11:08,628 INFO [RS:0;jenkins-hbase4:39681] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39681,1689469866446-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,630 INFO [RS:1;jenkins-hbase4:45775] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,631 INFO [RS:1;jenkins-hbase4:45775] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,631 INFO [RS:1;jenkins-hbase4:45775] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,641 INFO [RS:2;jenkins-hbase4:41029] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 01:11:08,642 INFO [RS:2;jenkins-hbase4:41029] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41029,1689469866571-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,655 INFO [RS:1;jenkins-hbase4:45775] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 01:11:08,655 INFO [RS:1;jenkins-hbase4:45775] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45775,1689469866515-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:08,661 INFO [RS:0;jenkins-hbase4:39681] regionserver.Replication(203): jenkins-hbase4.apache.org,39681,1689469866446 started 2023-07-16 01:11:08,662 INFO [RS:2;jenkins-hbase4:41029] regionserver.Replication(203): jenkins-hbase4.apache.org,41029,1689469866571 started 2023-07-16 01:11:08,662 INFO [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41029,1689469866571, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41029, sessionid=0x1016baeca7e0003 2023-07-16 01:11:08,662 INFO [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39681,1689469866446, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39681, sessionid=0x1016baeca7e0001 2023-07-16 01:11:08,662 DEBUG [RS:0;jenkins-hbase4:39681] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 01:11:08,662 DEBUG [RS:2;jenkins-hbase4:41029] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 01:11:08,662 DEBUG [RS:0;jenkins-hbase4:39681] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:08,662 DEBUG [RS:2;jenkins-hbase4:41029] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:08,663 DEBUG [RS:0;jenkins-hbase4:39681] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39681,1689469866446' 2023-07-16 01:11:08,663 DEBUG [RS:2;jenkins-hbase4:41029] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41029,1689469866571' 2023-07-16 01:11:08,664 DEBUG [RS:2;jenkins-hbase4:41029] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 01:11:08,664 DEBUG [RS:0;jenkins-hbase4:39681] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 01:11:08,665 DEBUG [RS:0;jenkins-hbase4:39681] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 01:11:08,665 DEBUG [RS:2;jenkins-hbase4:41029] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 01:11:08,665 DEBUG [RS:0;jenkins-hbase4:39681] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 01:11:08,665 DEBUG [RS:2;jenkins-hbase4:41029] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 01:11:08,666 DEBUG [RS:0;jenkins-hbase4:39681] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 01:11:08,666 DEBUG [RS:2;jenkins-hbase4:41029] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 01:11:08,666 DEBUG [RS:0;jenkins-hbase4:39681] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:08,666 DEBUG [RS:2;jenkins-hbase4:41029] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:08,667 DEBUG [RS:2;jenkins-hbase4:41029] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41029,1689469866571' 2023-07-16 01:11:08,667 DEBUG [RS:2;jenkins-hbase4:41029] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:08,666 DEBUG [RS:0;jenkins-hbase4:39681] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39681,1689469866446' 2023-07-16 01:11:08,667 DEBUG [RS:0;jenkins-hbase4:39681] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:08,667 DEBUG [RS:2;jenkins-hbase4:41029] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:08,667 DEBUG [RS:0;jenkins-hbase4:39681] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:08,668 DEBUG [RS:2;jenkins-hbase4:41029] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 01:11:08,668 DEBUG [RS:0;jenkins-hbase4:39681] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 01:11:08,668 INFO [RS:2;jenkins-hbase4:41029] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 01:11:08,668 INFO [RS:0;jenkins-hbase4:39681] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 01:11:08,669 INFO [RS:2;jenkins-hbase4:41029] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 01:11:08,669 INFO [RS:0;jenkins-hbase4:39681] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 01:11:08,675 INFO [RS:1;jenkins-hbase4:45775] regionserver.Replication(203): jenkins-hbase4.apache.org,45775,1689469866515 started 2023-07-16 01:11:08,675 INFO [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45775,1689469866515, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45775, sessionid=0x1016baeca7e0002 2023-07-16 01:11:08,675 DEBUG [RS:1;jenkins-hbase4:45775] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 01:11:08,675 DEBUG [RS:1;jenkins-hbase4:45775] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:08,675 DEBUG [RS:1;jenkins-hbase4:45775] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45775,1689469866515' 2023-07-16 01:11:08,675 DEBUG [RS:1;jenkins-hbase4:45775] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 01:11:08,676 DEBUG [RS:1;jenkins-hbase4:45775] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 01:11:08,676 DEBUG [RS:1;jenkins-hbase4:45775] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 01:11:08,677 DEBUG [RS:1;jenkins-hbase4:45775] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 01:11:08,677 DEBUG [RS:1;jenkins-hbase4:45775] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:08,677 DEBUG [RS:1;jenkins-hbase4:45775] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45775,1689469866515' 2023-07-16 01:11:08,677 DEBUG [RS:1;jenkins-hbase4:45775] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:08,677 DEBUG [RS:1;jenkins-hbase4:45775] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:08,678 DEBUG [RS:1;jenkins-hbase4:45775] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 01:11:08,678 INFO [RS:1;jenkins-hbase4:45775] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 01:11:08,678 INFO [RS:1;jenkins-hbase4:45775] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 01:11:08,757 DEBUG [jenkins-hbase4:39271] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-16 01:11:08,763 DEBUG [jenkins-hbase4:39271] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:11:08,771 DEBUG [jenkins-hbase4:39271] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:11:08,771 DEBUG [jenkins-hbase4:39271] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:11:08,771 DEBUG [jenkins-hbase4:39271] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:11:08,771 DEBUG [jenkins-hbase4:39271] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:11:08,776 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45775,1689469866515, state=OPENING 2023-07-16 01:11:08,783 INFO [RS:1;jenkins-hbase4:45775] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45775%2C1689469866515, suffix=, logDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/WALs/jenkins-hbase4.apache.org,45775,1689469866515, archiveDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/oldWALs, maxLogs=32 2023-07-16 01:11:08,783 INFO [RS:0;jenkins-hbase4:39681] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39681%2C1689469866446, suffix=, logDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/WALs/jenkins-hbase4.apache.org,39681,1689469866446, archiveDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/oldWALs, maxLogs=32 2023-07-16 01:11:08,788 INFO [RS:2;jenkins-hbase4:41029] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41029%2C1689469866571, suffix=, logDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/WALs/jenkins-hbase4.apache.org,41029,1689469866571, archiveDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/oldWALs, maxLogs=32 2023-07-16 01:11:08,798 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-16 01:11:08,799 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:08,800 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 01:11:08,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:11:08,856 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41135,DS-3bd37f57-393f-4fde-a060-52a570ae8dc7,DISK] 2023-07-16 01:11:08,856 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41981,DS-b579dd2d-1b32-4757-bca5-808c3128c6cc,DISK] 2023-07-16 01:11:08,856 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34573,DS-cd83b92f-a5fc-493f-8a8d-e55137dc5272,DISK] 2023-07-16 01:11:08,868 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41981,DS-b579dd2d-1b32-4757-bca5-808c3128c6cc,DISK] 2023-07-16 01:11:08,871 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41135,DS-3bd37f57-393f-4fde-a060-52a570ae8dc7,DISK] 2023-07-16 01:11:08,884 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41135,DS-3bd37f57-393f-4fde-a060-52a570ae8dc7,DISK] 2023-07-16 01:11:08,891 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34573,DS-cd83b92f-a5fc-493f-8a8d-e55137dc5272,DISK] 2023-07-16 01:11:08,891 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34573,DS-cd83b92f-a5fc-493f-8a8d-e55137dc5272,DISK] 2023-07-16 01:11:08,892 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41981,DS-b579dd2d-1b32-4757-bca5-808c3128c6cc,DISK] 2023-07-16 01:11:08,897 INFO [RS:2;jenkins-hbase4:41029] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/WALs/jenkins-hbase4.apache.org,41029,1689469866571/jenkins-hbase4.apache.org%2C41029%2C1689469866571.1689469868791 2023-07-16 01:11:08,898 DEBUG [RS:2;jenkins-hbase4:41029] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34573,DS-cd83b92f-a5fc-493f-8a8d-e55137dc5272,DISK], DatanodeInfoWithStorage[127.0.0.1:41981,DS-b579dd2d-1b32-4757-bca5-808c3128c6cc,DISK], DatanodeInfoWithStorage[127.0.0.1:41135,DS-3bd37f57-393f-4fde-a060-52a570ae8dc7,DISK]] 2023-07-16 01:11:08,904 INFO [RS:0;jenkins-hbase4:39681] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/WALs/jenkins-hbase4.apache.org,39681,1689469866446/jenkins-hbase4.apache.org%2C39681%2C1689469866446.1689469868791 2023-07-16 01:11:08,907 INFO [RS:1;jenkins-hbase4:45775] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/WALs/jenkins-hbase4.apache.org,45775,1689469866515/jenkins-hbase4.apache.org%2C45775%2C1689469866515.1689469868791 2023-07-16 01:11:08,910 DEBUG [RS:0;jenkins-hbase4:39681] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34573,DS-cd83b92f-a5fc-493f-8a8d-e55137dc5272,DISK], DatanodeInfoWithStorage[127.0.0.1:41135,DS-3bd37f57-393f-4fde-a060-52a570ae8dc7,DISK], DatanodeInfoWithStorage[127.0.0.1:41981,DS-b579dd2d-1b32-4757-bca5-808c3128c6cc,DISK]] 2023-07-16 01:11:08,923 DEBUG [RS:1;jenkins-hbase4:45775] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41981,DS-b579dd2d-1b32-4757-bca5-808c3128c6cc,DISK], DatanodeInfoWithStorage[127.0.0.1:34573,DS-cd83b92f-a5fc-493f-8a8d-e55137dc5272,DISK], DatanodeInfoWithStorage[127.0.0.1:41135,DS-3bd37f57-393f-4fde-a060-52a570ae8dc7,DISK]] 2023-07-16 01:11:09,082 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:09,085 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 01:11:09,090 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 01:11:09,105 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-16 01:11:09,105 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 01:11:09,109 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45775%2C1689469866515.meta, suffix=.meta, logDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/WALs/jenkins-hbase4.apache.org,45775,1689469866515, archiveDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/oldWALs, maxLogs=32 2023-07-16 01:11:09,135 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41135,DS-3bd37f57-393f-4fde-a060-52a570ae8dc7,DISK] 2023-07-16 01:11:09,136 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41981,DS-b579dd2d-1b32-4757-bca5-808c3128c6cc,DISK] 2023-07-16 01:11:09,151 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34573,DS-cd83b92f-a5fc-493f-8a8d-e55137dc5272,DISK] 2023-07-16 01:11:09,166 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/WALs/jenkins-hbase4.apache.org,45775,1689469866515/jenkins-hbase4.apache.org%2C45775%2C1689469866515.meta.1689469869110.meta 2023-07-16 01:11:09,167 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41981,DS-b579dd2d-1b32-4757-bca5-808c3128c6cc,DISK], DatanodeInfoWithStorage[127.0.0.1:41135,DS-3bd37f57-393f-4fde-a060-52a570ae8dc7,DISK], DatanodeInfoWithStorage[127.0.0.1:34573,DS-cd83b92f-a5fc-493f-8a8d-e55137dc5272,DISK]] 2023-07-16 01:11:09,168 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-16 01:11:09,169 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-16 01:11:09,171 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:09,172 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-16 01:11:09,175 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-16 01:11:09,177 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-16 01:11:09,196 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-16 01:11:09,196 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:09,196 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-16 01:11:09,196 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-16 01:11:09,210 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 01:11:09,215 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/info 2023-07-16 01:11:09,215 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/info 2023-07-16 01:11:09,216 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 01:11:09,217 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:09,217 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 01:11:09,219 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/rep_barrier 2023-07-16 01:11:09,219 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/rep_barrier 2023-07-16 01:11:09,220 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 01:11:09,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:09,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 01:11:09,225 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/table 2023-07-16 01:11:09,225 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/table 2023-07-16 01:11:09,225 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 01:11:09,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:09,229 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740 2023-07-16 01:11:09,232 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740 2023-07-16 01:11:09,236 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 01:11:09,239 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 01:11:09,241 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72275211, jitterRate=0.07698456943035126}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 01:11:09,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 01:11:09,261 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689469869071 2023-07-16 01:11:09,286 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-16 01:11:09,288 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-16 01:11:09,296 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45775,1689469866515, state=OPEN 2023-07-16 01:11:09,299 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-16 01:11:09,299 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 01:11:09,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-16 01:11:09,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45775,1689469866515 in 491 msec 2023-07-16 01:11:09,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-16 01:11:09,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 747 msec 2023-07-16 01:11:09,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3440 sec 2023-07-16 01:11:09,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689469869326, completionTime=-1 2023-07-16 01:11:09,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-16 01:11:09,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-16 01:11:09,421 DEBUG [hconnection-0x513c9ae2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:09,424 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:09,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-16 01:11:09,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689469929454 2023-07-16 01:11:09,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689469989454 2023-07-16 01:11:09,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 127 msec 2023-07-16 01:11:09,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39271,1689469864817-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:09,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39271,1689469864817-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:09,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39271,1689469864817-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:09,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39271, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:09,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-16 01:11:09,508 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-16 01:11:09,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-16 01:11:09,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 01:11:09,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-16 01:11:09,536 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:11:09,540 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:11:09,568 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c 2023-07-16 01:11:09,571 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c empty. 2023-07-16 01:11:09,572 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c 2023-07-16 01:11:09,572 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-16 01:11:09,622 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:09,624 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => dfd0e3c73b9b0359a47f8799cf573d4c, NAME => 'hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:11:09,661 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:09,661 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing dfd0e3c73b9b0359a47f8799cf573d4c, disabling compactions & flushes 2023-07-16 01:11:09,661 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. 2023-07-16 01:11:09,661 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. 2023-07-16 01:11:09,661 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. after waiting 0 ms 2023-07-16 01:11:09,661 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. 2023-07-16 01:11:09,661 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. 2023-07-16 01:11:09,662 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for dfd0e3c73b9b0359a47f8799cf573d4c: 2023-07-16 01:11:09,667 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:11:09,689 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689469869671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469869671"}]},"ts":"1689469869671"} 2023-07-16 01:11:09,728 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 01:11:09,730 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:11:09,736 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469869730"}]},"ts":"1689469869730"} 2023-07-16 01:11:09,745 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-16 01:11:09,751 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:11:09,753 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:11:09,753 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:11:09,753 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:11:09,753 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:11:09,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dfd0e3c73b9b0359a47f8799cf573d4c, ASSIGN}] 2023-07-16 01:11:09,760 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=dfd0e3c73b9b0359a47f8799cf573d4c, ASSIGN 2023-07-16 01:11:09,763 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=dfd0e3c73b9b0359a47f8799cf573d4c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41029,1689469866571; forceNewPlan=false, retain=false 2023-07-16 01:11:09,915 INFO [jenkins-hbase4:39271] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 01:11:09,916 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dfd0e3c73b9b0359a47f8799cf573d4c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:09,917 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689469869916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469869916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469869916"}]},"ts":"1689469869916"} 2023-07-16 01:11:09,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure dfd0e3c73b9b0359a47f8799cf573d4c, server=jenkins-hbase4.apache.org,41029,1689469866571}] 2023-07-16 01:11:10,075 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:10,076 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 01:11:10,079 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 01:11:10,086 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. 2023-07-16 01:11:10,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dfd0e3c73b9b0359a47f8799cf573d4c, NAME => 'hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c.', STARTKEY => '', ENDKEY => ''} 2023-07-16 01:11:10,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. service=AccessControlService 2023-07-16 01:11:10,087 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:10,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace dfd0e3c73b9b0359a47f8799cf573d4c 2023-07-16 01:11:10,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:10,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dfd0e3c73b9b0359a47f8799cf573d4c 2023-07-16 01:11:10,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dfd0e3c73b9b0359a47f8799cf573d4c 2023-07-16 01:11:10,090 INFO [StoreOpener-dfd0e3c73b9b0359a47f8799cf573d4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region dfd0e3c73b9b0359a47f8799cf573d4c 2023-07-16 01:11:10,092 DEBUG [StoreOpener-dfd0e3c73b9b0359a47f8799cf573d4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c/info 2023-07-16 01:11:10,092 DEBUG [StoreOpener-dfd0e3c73b9b0359a47f8799cf573d4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c/info 2023-07-16 01:11:10,093 INFO [StoreOpener-dfd0e3c73b9b0359a47f8799cf573d4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dfd0e3c73b9b0359a47f8799cf573d4c columnFamilyName info 2023-07-16 01:11:10,094 INFO [StoreOpener-dfd0e3c73b9b0359a47f8799cf573d4c-1] regionserver.HStore(310): Store=dfd0e3c73b9b0359a47f8799cf573d4c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:10,095 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c 2023-07-16 01:11:10,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c 2023-07-16 01:11:10,100 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dfd0e3c73b9b0359a47f8799cf573d4c 2023-07-16 01:11:10,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:10,105 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dfd0e3c73b9b0359a47f8799cf573d4c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67809887, jitterRate=0.010446056723594666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:10,105 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dfd0e3c73b9b0359a47f8799cf573d4c: 2023-07-16 01:11:10,107 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c., pid=6, masterSystemTime=1689469870075 2023-07-16 01:11:10,112 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. 2023-07-16 01:11:10,112 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. 2023-07-16 01:11:10,113 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=dfd0e3c73b9b0359a47f8799cf573d4c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:10,114 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689469870113"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469870113"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469870113"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469870113"}]},"ts":"1689469870113"} 2023-07-16 01:11:10,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-16 01:11:10,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure dfd0e3c73b9b0359a47f8799cf573d4c, server=jenkins-hbase4.apache.org,41029,1689469866571 in 197 msec 2023-07-16 01:11:10,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-16 01:11:10,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=dfd0e3c73b9b0359a47f8799cf573d4c, ASSIGN in 366 msec 2023-07-16 01:11:10,128 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:11:10,128 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469870128"}]},"ts":"1689469870128"} 2023-07-16 01:11:10,130 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-16 01:11:10,134 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:11:10,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-16 01:11:10,137 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-16 01:11:10,137 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:10,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 611 msec 2023-07-16 01:11:10,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:10,160 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:10,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-16 01:11:10,203 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 01:11:10,212 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 44 msec 2023-07-16 01:11:10,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-16 01:11:10,237 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 01:11:10,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-16 01:11:10,250 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-16 01:11:10,252 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-16 01:11:10,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.601sec 2023-07-16 01:11:10,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-16 01:11:10,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-16 01:11:10,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-16 01:11:10,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39271,1689469864817-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-16 01:11:10,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39271,1689469864817-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-16 01:11:10,277 DEBUG [Listener at localhost/33183] zookeeper.ReadOnlyZKClient(139): Connect 0x44e82ad3 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:10,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 01:11:10,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-16 01:11:10,289 DEBUG [Listener at localhost/33183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@276e1f5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:10,291 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:11:10,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-16 01:11:10,302 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:11:10,313 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 01:11:10,314 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31 2023-07-16 01:11:10,315 DEBUG [hconnection-0x58da017a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:10,316 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31 empty. 2023-07-16 01:11:10,319 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31 2023-07-16 01:11:10,319 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-16 01:11:10,333 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:10,336 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39271,1689469864817 2023-07-16 01:11:10,336 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-16 01:11:10,336 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/test.cache.data in system properties and HBase conf 2023-07-16 01:11:10,337 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 01:11:10,337 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop.log.dir in system properties and HBase conf 2023-07-16 01:11:10,337 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 01:11:10,337 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 01:11:10,337 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 01:11:10,337 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 01:11:10,337 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 01:11:10,339 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 01:11:10,339 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 01:11:10,339 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 01:11:10,339 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 01:11:10,339 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 01:11:10,340 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 01:11:10,340 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 01:11:10,340 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/nfs.dump.dir in system properties and HBase conf 2023-07-16 01:11:10,340 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/java.io.tmpdir in system properties and HBase conf 2023-07-16 01:11:10,340 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 01:11:10,344 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 01:11:10,344 INFO [Listener at localhost/33183] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-16 01:11:10,354 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:10,356 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 31eeec3d04f822bd09ae6624a8c00b31, NAME => 'hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:11:10,390 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:10,391 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 31eeec3d04f822bd09ae6624a8c00b31, disabling compactions & flushes 2023-07-16 01:11:10,391 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. 2023-07-16 01:11:10,391 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. 2023-07-16 01:11:10,391 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. after waiting 0 ms 2023-07-16 01:11:10,391 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. 2023-07-16 01:11:10,391 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. 2023-07-16 01:11:10,391 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 31eeec3d04f822bd09ae6624a8c00b31: 2023-07-16 01:11:10,397 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:11:10,405 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689469870404"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469870404"}]},"ts":"1689469870404"} 2023-07-16 01:11:10,410 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 01:11:10,413 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:11:10,414 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469870413"}]},"ts":"1689469870413"} 2023-07-16 01:11:10,416 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-16 01:11:10,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 01:11:10,423 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:11:10,425 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:11:10,425 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:11:10,425 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:11:10,425 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:11:10,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=31eeec3d04f822bd09ae6624a8c00b31, ASSIGN}] 2023-07-16 01:11:10,442 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=31eeec3d04f822bd09ae6624a8c00b31, ASSIGN 2023-07-16 01:11:10,446 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=31eeec3d04f822bd09ae6624a8c00b31, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39681,1689469866446; forceNewPlan=false, retain=false 2023-07-16 01:11:10,597 INFO [jenkins-hbase4:39271] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 01:11:10,598 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=31eeec3d04f822bd09ae6624a8c00b31, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:10,598 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689469870598"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469870598"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469870598"}]},"ts":"1689469870598"} 2023-07-16 01:11:10,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 31eeec3d04f822bd09ae6624a8c00b31, server=jenkins-hbase4.apache.org,39681,1689469866446}] 2023-07-16 01:11:10,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 01:11:10,758 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:10,758 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 01:11:10,762 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 01:11:10,769 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. 2023-07-16 01:11:10,769 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 31eeec3d04f822bd09ae6624a8c00b31, NAME => 'hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31.', STARTKEY => '', ENDKEY => ''} 2023-07-16 01:11:10,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. service=AccessControlService 2023-07-16 01:11:10,770 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:10,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 31eeec3d04f822bd09ae6624a8c00b31 2023-07-16 01:11:10,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:10,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 31eeec3d04f822bd09ae6624a8c00b31 2023-07-16 01:11:10,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 31eeec3d04f822bd09ae6624a8c00b31 2023-07-16 01:11:10,773 INFO [StoreOpener-31eeec3d04f822bd09ae6624a8c00b31-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 31eeec3d04f822bd09ae6624a8c00b31 2023-07-16 01:11:10,776 DEBUG [StoreOpener-31eeec3d04f822bd09ae6624a8c00b31-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31/l 2023-07-16 01:11:10,776 DEBUG [StoreOpener-31eeec3d04f822bd09ae6624a8c00b31-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31/l 2023-07-16 01:11:10,776 INFO [StoreOpener-31eeec3d04f822bd09ae6624a8c00b31-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31eeec3d04f822bd09ae6624a8c00b31 columnFamilyName l 2023-07-16 01:11:10,777 INFO [StoreOpener-31eeec3d04f822bd09ae6624a8c00b31-1] regionserver.HStore(310): Store=31eeec3d04f822bd09ae6624a8c00b31/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:10,780 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31 2023-07-16 01:11:10,781 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31 2023-07-16 01:11:10,786 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 31eeec3d04f822bd09ae6624a8c00b31 2023-07-16 01:11:10,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:10,795 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 31eeec3d04f822bd09ae6624a8c00b31; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69208424, jitterRate=0.031285881996154785}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:10,796 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 31eeec3d04f822bd09ae6624a8c00b31: 2023-07-16 01:11:10,798 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31., pid=11, masterSystemTime=1689469870758 2023-07-16 01:11:10,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. 2023-07-16 01:11:10,805 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. 2023-07-16 01:11:10,806 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=31eeec3d04f822bd09ae6624a8c00b31, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:10,806 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689469870806"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469870806"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469870806"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469870806"}]},"ts":"1689469870806"} 2023-07-16 01:11:10,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-16 01:11:10,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 31eeec3d04f822bd09ae6624a8c00b31, server=jenkins-hbase4.apache.org,39681,1689469866446 in 208 msec 2023-07-16 01:11:10,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-16 01:11:10,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=31eeec3d04f822bd09ae6624a8c00b31, ASSIGN in 391 msec 2023-07-16 01:11:10,821 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:11:10,822 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469870822"}]},"ts":"1689469870822"} 2023-07-16 01:11:10,824 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-16 01:11:10,828 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:11:10,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 542 msec 2023-07-16 01:11:10,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 01:11:10,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-16 01:11:11,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-16 01:11:11,887 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:12,274 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:12,280 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33181_jobhistory____.2br6j1/webapp 2023-07-16 01:11:12,453 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-16 01:11:12,454 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-16 01:11:12,454 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 01:11:12,457 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 01:11:12,549 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:12,893 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:13,240 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-16 01:11:13,319 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33181 2023-07-16 01:11:14,759 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:11:14,844 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-16 01:11:14,845 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-16 01:11:14,847 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-16 01:11:14,881 WARN [Listener at jenkins-hbase4.apache.org/36005] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:15,090 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:15,091 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-16 01:11:15,092 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:15,092 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-16 01:11:15,092 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 01:11:15,092 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-16 01:11:15,093 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:15,093 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-16 01:11:15,093 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 01:11:15,093 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-16 01:11:15,196 WARN [Listener at jenkins-hbase4.apache.org/36005] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 01:11:15,197 INFO [Listener at jenkins-hbase4.apache.org/36005] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:15,208 INFO [Listener at jenkins-hbase4.apache.org/36005] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42879_cluster____63i0qw/webapp 2023-07-16 01:11:15,288 INFO [Listener at jenkins-hbase4.apache.org/36005] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 01:11:15,288 INFO [Listener at jenkins-hbase4.apache.org/36005] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-16 01:11:15,288 INFO [Listener at jenkins-hbase4.apache.org/36005] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 01:11:15,289 INFO [Listener at jenkins-hbase4.apache.org/36005] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 01:11:15,301 INFO [Listener at jenkins-hbase4.apache.org/36005] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:15,515 INFO [Listener at jenkins-hbase4.apache.org/36005] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:15,650 INFO [Listener at jenkins-hbase4.apache.org/36005] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:15,663 INFO [Listener at jenkins-hbase4.apache.org/36005] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42879 2023-07-16 01:11:16,235 WARN [Listener at jenkins-hbase4.apache.org/44795] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:16,263 WARN [Listener at jenkins-hbase4.apache.org/44795] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 01:11:16,264 INFO [Listener at jenkins-hbase4.apache.org/44795] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:16,272 INFO [Listener at jenkins-hbase4.apache.org/44795] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38883_node____.irllg/webapp 2023-07-16 01:11:16,328 INFO [Listener at jenkins-hbase4.apache.org/44795] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 01:11:16,329 INFO [Listener at jenkins-hbase4.apache.org/44795] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 01:11:16,329 INFO [Listener at jenkins-hbase4.apache.org/44795] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 01:11:16,329 INFO [Listener at jenkins-hbase4.apache.org/44795] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 01:11:16,340 INFO [Listener at jenkins-hbase4.apache.org/44795] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:16,369 INFO [Listener at jenkins-hbase4.apache.org/44795] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:16,503 INFO [Listener at jenkins-hbase4.apache.org/44795] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:16,526 INFO [Listener at jenkins-hbase4.apache.org/44795] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38883 2023-07-16 01:11:16,797 WARN [Listener at jenkins-hbase4.apache.org/39957] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 01:11:16,805 WARN [Listener at jenkins-hbase4.apache.org/39957] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 01:11:16,806 INFO [Listener at jenkins-hbase4.apache.org/39957] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 01:11:16,816 INFO [Listener at jenkins-hbase4.apache.org/39957] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44591_node____.aaabsl/webapp 2023-07-16 01:11:16,890 INFO [Listener at jenkins-hbase4.apache.org/39957] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 01:11:16,890 INFO [Listener at jenkins-hbase4.apache.org/39957] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 01:11:16,890 INFO [Listener at jenkins-hbase4.apache.org/39957] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 01:11:16,890 INFO [Listener at jenkins-hbase4.apache.org/39957] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 01:11:16,902 INFO [Listener at jenkins-hbase4.apache.org/39957] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:16,933 INFO [Listener at jenkins-hbase4.apache.org/39957] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:17,038 INFO [Listener at jenkins-hbase4.apache.org/39957] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 01:11:17,047 INFO [Listener at jenkins-hbase4.apache.org/39957] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44591 2023-07-16 01:11:17,086 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-16 01:11:17,087 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:17,177 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=290, ProcessCount=175, AvailableMemoryMB=4744 2023-07-16 01:11:17,177 WARN [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-07-16 01:11:17,192 DEBUG [Listener at jenkins-hbase4.apache.org/39957] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-16 01:11:17,198 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-16 01:11:17,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 01:11:17,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:17,212 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:11:17,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-16 01:11:17,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 01:11:17,215 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:11:17,220 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:17,220 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:17,224 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba empty. 2023-07-16 01:11:17,224 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44 empty. 2023-07-16 01:11:17,226 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:17,226 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:17,226 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 01:11:17,262 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:17,264 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => b3b58d0c7639e2b5c812cd74a9fd1a44, NAME => 'testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:11:17,264 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => be4307162dff301d0ecf4892b2ea3bba, NAME => 'testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:11:17,310 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:17,311 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing b3b58d0c7639e2b5c812cd74a9fd1a44, disabling compactions & flushes 2023-07-16 01:11:17,311 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:17,311 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:17,311 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. after waiting 0 ms 2023-07-16 01:11:17,311 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:17,312 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:17,312 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for b3b58d0c7639e2b5c812cd74a9fd1a44: 2023-07-16 01:11:17,312 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:17,313 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing be4307162dff301d0ecf4892b2ea3bba, disabling compactions & flushes 2023-07-16 01:11:17,313 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:17,313 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:17,313 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. after waiting 0 ms 2023-07-16 01:11:17,313 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:17,313 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:17,313 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for be4307162dff301d0ecf4892b2ea3bba: 2023-07-16 01:11:17,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 01:11:17,317 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:11:17,319 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469877319"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469877319"}]},"ts":"1689469877319"} 2023-07-16 01:11:17,319 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469877319"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469877319"}]},"ts":"1689469877319"} 2023-07-16 01:11:17,374 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:11:17,376 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:11:17,376 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469877376"}]},"ts":"1689469877376"} 2023-07-16 01:11:17,378 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-16 01:11:17,383 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:11:17,385 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:11:17,385 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:11:17,385 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:11:17,385 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:11:17,386 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be4307162dff301d0ecf4892b2ea3bba, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b3b58d0c7639e2b5c812cd74a9fd1a44, ASSIGN}] 2023-07-16 01:11:17,391 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b3b58d0c7639e2b5c812cd74a9fd1a44, ASSIGN 2023-07-16 01:11:17,391 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be4307162dff301d0ecf4892b2ea3bba, ASSIGN 2023-07-16 01:11:17,393 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be4307162dff301d0ecf4892b2ea3bba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45775,1689469866515; forceNewPlan=false, retain=false 2023-07-16 01:11:17,393 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b3b58d0c7639e2b5c812cd74a9fd1a44, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41029,1689469866571; forceNewPlan=false, retain=false 2023-07-16 01:11:17,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 01:11:17,543 INFO [jenkins-hbase4:39271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:11:17,546 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b3b58d0c7639e2b5c812cd74a9fd1a44, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:17,546 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=be4307162dff301d0ecf4892b2ea3bba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:17,546 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469877546"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469877546"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469877546"}]},"ts":"1689469877546"} 2023-07-16 01:11:17,546 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469877546"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469877546"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469877546"}]},"ts":"1689469877546"} 2023-07-16 01:11:17,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure b3b58d0c7639e2b5c812cd74a9fd1a44, server=jenkins-hbase4.apache.org,41029,1689469866571}] 2023-07-16 01:11:17,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure be4307162dff301d0ecf4892b2ea3bba, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:11:17,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:17,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b3b58d0c7639e2b5c812cd74a9fd1a44, NAME => 'testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 01:11:17,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. service=AccessControlService 2023-07-16 01:11:17,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:17,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:17,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:17,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:17,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:17,714 INFO [StoreOpener-b3b58d0c7639e2b5c812cd74a9fd1a44-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:17,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:17,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be4307162dff301d0ecf4892b2ea3bba, NAME => 'testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 01:11:17,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. service=AccessControlService 2023-07-16 01:11:17,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:17,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:17,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:17,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:17,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:17,716 DEBUG [StoreOpener-b3b58d0c7639e2b5c812cd74a9fd1a44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/cf 2023-07-16 01:11:17,716 DEBUG [StoreOpener-b3b58d0c7639e2b5c812cd74a9fd1a44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/cf 2023-07-16 01:11:17,717 INFO [StoreOpener-b3b58d0c7639e2b5c812cd74a9fd1a44-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3b58d0c7639e2b5c812cd74a9fd1a44 columnFamilyName cf 2023-07-16 01:11:17,717 INFO [StoreOpener-b3b58d0c7639e2b5c812cd74a9fd1a44-1] regionserver.HStore(310): Store=b3b58d0c7639e2b5c812cd74a9fd1a44/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:17,717 INFO [StoreOpener-be4307162dff301d0ecf4892b2ea3bba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:17,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:17,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:17,720 DEBUG [StoreOpener-be4307162dff301d0ecf4892b2ea3bba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/cf 2023-07-16 01:11:17,720 DEBUG [StoreOpener-be4307162dff301d0ecf4892b2ea3bba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/cf 2023-07-16 01:11:17,721 INFO [StoreOpener-be4307162dff301d0ecf4892b2ea3bba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be4307162dff301d0ecf4892b2ea3bba columnFamilyName cf 2023-07-16 01:11:17,721 INFO [StoreOpener-be4307162dff301d0ecf4892b2ea3bba-1] regionserver.HStore(310): Store=be4307162dff301d0ecf4892b2ea3bba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:17,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:17,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:17,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:17,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:17,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:17,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b3b58d0c7639e2b5c812cd74a9fd1a44; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73321978, jitterRate=0.09258261322975159}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:17,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b3b58d0c7639e2b5c812cd74a9fd1a44: 2023-07-16 01:11:17,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44., pid=15, masterSystemTime=1689469877703 2023-07-16 01:11:17,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:17,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened be4307162dff301d0ecf4892b2ea3bba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63561648, jitterRate=-0.05285763740539551}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:17,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for be4307162dff301d0ecf4892b2ea3bba: 2023-07-16 01:11:17,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba., pid=16, masterSystemTime=1689469877708 2023-07-16 01:11:17,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:17,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:17,780 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b3b58d0c7639e2b5c812cd74a9fd1a44, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:17,780 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469877779"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469877779"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469877779"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469877779"}]},"ts":"1689469877779"} 2023-07-16 01:11:17,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:17,785 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=be4307162dff301d0ecf4892b2ea3bba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:17,787 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469877785"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469877785"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469877785"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469877785"}]},"ts":"1689469877785"} 2023-07-16 01:11:17,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:17,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-16 01:11:17,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure b3b58d0c7639e2b5c812cd74a9fd1a44, server=jenkins-hbase4.apache.org,41029,1689469866571 in 233 msec 2023-07-16 01:11:17,802 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b3b58d0c7639e2b5c812cd74a9fd1a44, ASSIGN in 412 msec 2023-07-16 01:11:17,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-16 01:11:17,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure be4307162dff301d0ecf4892b2ea3bba, server=jenkins-hbase4.apache.org,45775,1689469866515 in 243 msec 2023-07-16 01:11:17,807 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-16 01:11:17,807 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be4307162dff301d0ecf4892b2ea3bba, ASSIGN in 418 msec 2023-07-16 01:11:17,808 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:11:17,808 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469877808"}]},"ts":"1689469877808"} 2023-07-16 01:11:17,812 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-16 01:11:17,816 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:11:17,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 01:11:17,823 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-16 01:11:17,830 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:17,835 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:17,841 DEBUG [hconnection-0x32f2f16b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:17,845 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-16 01:11:17,855 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 01:11:17,900 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:17,900 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:17,900 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:17,900 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:17,901 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:11:17,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:17,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:17,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:17,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:17,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 719 msec 2023-07-16 01:11:18,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 01:11:18,322 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-16 01:11:18,322 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-16 01:11:18,323 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:18,328 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-16 01:11:18,329 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:18,329 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-16 01:11:18,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 01:11:18,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469878345 (current time:1689469878345). 2023-07-16 01:11:18,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:11:18,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x4aa59bb1 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:18,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40edba91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:18,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:18,356 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:18,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4aa59bb1 to 127.0.0.1:64468 2023-07-16 01:11:18,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:18,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x5be91423 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:18,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ff5036d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:18,367 DEBUG [hconnection-0x145ac482-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:18,369 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:18,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:18,376 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:18,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5be91423 to 127.0.0.1:64468 2023-07-16 01:11:18,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:18,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 01:11:18,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:11:18,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 01:11:18,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 01:11:18,434 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 01:11:18,435 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689470478435 2023-07-16 01:11:18,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 01:11:18,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 01:11:18,439 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 01:11:18,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 01:11:18,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-16 01:11:18,443 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:11:18,443 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:11:18,445 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 01:11:18,446 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689470478446 2023-07-16 01:11:18,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,483 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-16 01:11:18,483 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:18,484 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 01:11:18,484 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 01:11:18,485 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,485 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,490 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:18,490 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:18,490 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:18,490 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:18,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:18,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:18,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:18,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:18,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:18,491 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,491 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,492 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,492 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:11:18,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 01:11:18,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 01:11:18,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,495 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 01:11:18,495 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 01:11:18,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 01:11:18,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,498 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 01:11:18,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,498 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 01:11:18,498 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:18,498 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 01:11:18,500 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 01:11:18,498 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 01:11:18,501 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 01:11:18,500 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:18,501 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 01:11:18,502 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 01:11:18,502 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 01:11:18,501 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:18,502 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 01:11:18,503 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 01:11:18,503 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 01:11:18,503 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 01:11:18,506 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,506 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,506 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,506 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:18,508 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,508 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,508 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,508 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:18,508 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:18,508 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,508 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:18,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:18,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:18,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 01:11:18,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b27fdc8[Count = 1] remaining members to acquire global barrier 2023-07-16 01:11:18,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:18,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:18,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:18,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:18,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:18,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:18,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 01:11:18,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b27fdc8[Count = 0] remaining members to acquire global barrier 2023-07-16 01:11:18,515 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 01:11:18,515 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,523 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,523 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,523 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,524 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,524 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 01:11:18,524 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 01:11:18,524 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 01:11:18,524 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:11:18,525 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,525 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:11:18,526 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:18,526 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 01:11:18,526 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:18,526 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:18,528 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 01:11:18,528 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:18,528 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 01:11:18,528 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. started... 2023-07-16 01:11:18,532 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be4307162dff301d0ecf4892b2ea3bba: 2023-07-16 01:11:18,534 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,534 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:18,534 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:18,534 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:18,534 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. started... 2023-07-16 01:11:18,536 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b3b58d0c7639e2b5c812cd74a9fd1a44: 2023-07-16 01:11:18,536 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,542 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:18,543 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:18,544 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:18,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:18,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:18,548 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:11:18,548 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:11:18,548 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:11:18,608 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. completed. 2023-07-16 01:11:18,608 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:18,609 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:18,609 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:18,609 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,609 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 01:11:18,609 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:11:18,611 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,611 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 01:11:18,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:18,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:18,611 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:18,612 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 01:11:18,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:18,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:18,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,616 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. completed. 2023-07-16 01:11:18,616 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:18,616 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:18,616 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:18,616 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,616 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 01:11:18,616 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:11:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,618 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,619 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 01:11:18,619 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:18,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:18,619 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 01:11:18,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:18,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41029,1689469866571': 2023-07-16 01:11:18,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 01:11:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:18,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:18,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:18,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:18,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:18,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45775,1689469866515': 2023-07-16 01:11:18,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 01:11:18,627 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-16 01:11:18,627 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:11:18,627 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:11:18,627 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,627 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:11:18,630 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,630 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,630 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,630 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:18,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,630 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:18,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:18,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:18,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,630 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,630 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:18,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:18,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:18,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:18,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:18,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:18,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:18,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:18,635 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,636 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:18,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:18,637 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:18,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:18,640 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,641 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:18,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,641 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:18,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,658 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:18,658 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:18,658 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:18,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:18,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:18,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:18,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:18,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:18,659 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:18,658 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:18,659 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:18,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:18,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:18,663 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:18,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:18,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:18,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:18,663 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:18,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:18,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:18,663 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,663 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:18,663 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,664 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:18,664 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:18,664 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,664 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,748 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:18,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:18,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:18,750 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:11:18,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 01:11:18,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,786 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:18,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689469878435Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689469878659 (+224 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689469878659Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689469878681 (+22 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689469878718 (+37 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689469878785 (+67 ms) 2023-07-16 01:11:18,788 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 01:11:18,790 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 351 msec 2023-07-16 01:11:19,051 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:19,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:19,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:11:19,075 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:19,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45775] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:11:19,081 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:19,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41029] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:11:19,088 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-16 01:11:19,090 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:19,092 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:19,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 01:11:19,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469879119 (current time:1689469879119). 2023-07-16 01:11:19,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:11:19,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x358b84ba to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:19,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b34b028, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:19,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:19,129 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:19,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x358b84ba to 127.0.0.1:64468 2023-07-16 01:11:19,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:19,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x68c67d85 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:19,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1819a73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:19,137 DEBUG [hconnection-0x3f8adf9b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:19,140 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:19,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:19,146 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:19,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68c67d85 to 127.0.0.1:64468 2023-07-16 01:11:19,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:19,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 01:11:19,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:11:19,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 01:11:19,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 01:11:19,153 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 01:11:19,154 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689470479154 2023-07-16 01:11:19,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 01:11:19,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 01:11:19,156 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:11:19,156 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:11:19,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 01:11:19,158 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 01:11:19,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-16 01:11:19,160 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 01:11:19,161 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689470479161 2023-07-16 01:11:19,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-16 01:11:19,187 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-16 01:11:19,187 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:19,188 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 01:11:19,188 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 01:11:19,189 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,189 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,192 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:19,192 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,192 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:19,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:19,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:19,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:19,192 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:19,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:19,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:19,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:19,192 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,192 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,193 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,193 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:11:19,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 01:11:19,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,195 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 01:11:19,195 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 01:11:19,195 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 01:11:19,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 01:11:19,195 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:19,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 01:11:19,197 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 01:11:19,197 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 01:11:19,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,197 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 01:11:19,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 01:11:19,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 01:11:19,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 01:11:19,197 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 01:11:19,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 01:11:19,198 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:19,198 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 01:11:19,199 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:19,199 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 01:11:19,200 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 01:11:19,200 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 01:11:19,201 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 01:11:19,201 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 01:11:19,201 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 01:11:19,202 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,202 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:19,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:19,207 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,207 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:19,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:19,208 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,208 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,209 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,209 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:19,209 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:19,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:19,209 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,209 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:19,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:19,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:19,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 01:11:19,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4efa61c9[Count = 1] remaining members to acquire global barrier 2023-07-16 01:11:19,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:19,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:19,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:19,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:19,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:19,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:19,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 01:11:19,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4efa61c9[Count = 0] remaining members to acquire global barrier 2023-07-16 01:11:19,219 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 01:11:19,219 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,225 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,225 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,225 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,225 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 01:11:19,225 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,225 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 01:11:19,225 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:11:19,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,226 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 01:11:19,226 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 01:11:19,226 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,226 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:11:19,226 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:19,226 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:19,226 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:19,226 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:19,226 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. started... 2023-07-16 01:11:19,226 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. started... 2023-07-16 01:11:19,226 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:19,226 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:19,226 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2745): Flushing be4307162dff301d0ecf4892b2ea3bba 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 01:11:19,227 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b3b58d0c7639e2b5c812cd74a9fd1a44 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 01:11:19,229 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 01:11:19,229 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:19,229 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 01:11:19,256 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:19,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:19,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:19,258 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:11:19,458 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:19,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:19,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:19,460 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:11:19,740 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/.tmp/cf/50c63d6edeab456997794919d74884bb 2023-07-16 01:11:19,740 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/.tmp/cf/d571893c50fb4e99b5179b49ff344e9c 2023-07-16 01:11:19,760 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:19,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:19,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:19,762 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 01:11:19,801 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/.tmp/cf/d571893c50fb4e99b5179b49ff344e9c as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/cf/d571893c50fb4e99b5179b49ff344e9c 2023-07-16 01:11:19,801 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/.tmp/cf/50c63d6edeab456997794919d74884bb as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/cf/50c63d6edeab456997794919d74884bb 2023-07-16 01:11:19,811 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/cf/d571893c50fb4e99b5179b49ff344e9c, entries=47, sequenceid=6, filesize=8.0 K 2023-07-16 01:11:19,813 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/cf/50c63d6edeab456997794919d74884bb, entries=3, sequenceid=6, filesize=5.0 K 2023-07-16 01:11:19,818 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for be4307162dff301d0ecf4892b2ea3bba in 592ms, sequenceid=6, compaction requested=false 2023-07-16 01:11:19,818 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for b3b58d0c7639e2b5c812cd74a9fd1a44 in 592ms, sequenceid=6, compaction requested=false 2023-07-16 01:11:19,818 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 01:11:19,818 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 01:11:19,821 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be4307162dff301d0ecf4892b2ea3bba: 2023-07-16 01:11:19,821 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b3b58d0c7639e2b5c812cd74a9fd1a44: 2023-07-16 01:11:19,821 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 01:11:19,821 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 01:11:19,822 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:19,822 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:19,822 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/cf/50c63d6edeab456997794919d74884bb] hfiles 2023-07-16 01:11:19,822 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/cf/d571893c50fb4e99b5179b49ff344e9c] hfiles 2023-07-16 01:11:19,822 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/cf/50c63d6edeab456997794919d74884bb for snapshot=snaptb0-testExportWithTargetName 2023-07-16 01:11:19,822 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/cf/d571893c50fb4e99b5179b49ff344e9c for snapshot=snaptb0-testExportWithTargetName 2023-07-16 01:11:19,847 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. completed. 2023-07-16 01:11:19,847 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:19,848 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:19,848 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:19,848 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,848 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 01:11:19,848 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:11:19,850 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,851 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 01:11:19,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:19,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:19,851 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:19,851 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 01:11:19,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:19,854 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. completed. 2023-07-16 01:11:19,854 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:19,854 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:19,854 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:19,854 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,854 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 01:11:19,854 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:11:19,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:19,856 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 01:11:19,856 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:19,856 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 01:11:19,859 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:19,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:19,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:19,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45775,1689469866515': 2023-07-16 01:11:19,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 01:11:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:19,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:19,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41029,1689469866571': 2023-07-16 01:11:19,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 01:11:19,869 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-16 01:11:19,869 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:11:19,869 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:11:19,869 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-16 01:11:19,869 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:11:19,872 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,872 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,872 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,872 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,872 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:19,872 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,873 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:19,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:19,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:19,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:19,874 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,874 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:19,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:19,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,875 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:19,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:19,878 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 01:11:19,878 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,879 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:19,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,891 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,891 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:19,891 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:19,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:19,891 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,891 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:19,891 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:19,891 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:19,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-16 01:11:19,891 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:19,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-16 01:11:19,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:19,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:19,892 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:19,891 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,891 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:19,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:19,892 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:19,892 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:19,893 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,893 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:19,893 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:19,893 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,893 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 01:11:19,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:19,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:19,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:19,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 01:11:20,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,001 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 01:11:20,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689469879155Consolidate snapshot: snaptb0-testExportWithTargetName at 1689469879892 (+737 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689469879892Writing data manifest for snaptb0-testExportWithTargetName at 1689469879899 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689469879931 (+32 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689469880000 (+69 ms) 2023-07-16 01:11:20,003 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 01:11:20,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 847 msec 2023-07-16 01:11:20,263 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:20,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 01:11:20,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:11:20,266 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469880266 2023-07-16 01:11:20,267 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40869, tgtDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469880266, rawTgtDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469880266, srcFsUri=hdfs://localhost:40869, srcDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:11:20,326 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:11:20,326 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_792826575_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469880266, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469880266/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 01:11:20,326 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5, snapshotDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-16 01:11:20,351 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469880266/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 01:11:20,506 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:20,507 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:20,508 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:20,509 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,540 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-2704168685163799449.jar 2023-07-16 01:11:21,541 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,541 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,616 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-7321446338611024166.jar 2023-07-16 01:11:21,617 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,617 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,618 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,619 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,619 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,620 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:21,621 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:11:21,622 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:11:21,622 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:11:21,623 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:11:21,624 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:11:21,625 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:11:21,625 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:11:21,626 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:11:21,626 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:11:21,627 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:11:21,631 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:21,631 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:21,632 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:21,632 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:21,633 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:21,634 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:21,634 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:23,187 WARN [Listener at jenkins-hbase4.apache.org/39957] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:11:23,194 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-16 01:11:23,206 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 01:11:23,227 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:11:23,912 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:11:23,913 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:11:24,265 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0001_000001 (auth:SIMPLE) 2023-07-16 01:11:29,554 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0001_000001 (auth:SIMPLE) 2023-07-16 01:11:31,831 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0001_000001 (auth:SIMPLE) 2023-07-16 01:11:35,470 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0001_000001 (auth:SIMPLE) 2023-07-16 01:11:37,323 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:11:37,325 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:11:37,334 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-16 01:11:37,334 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:11:37,335 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:11:37,335 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1398488159_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 01:11:37,336 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-16 01:11:37,336 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-16 01:11:37,336 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1398488159_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469880266/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469880266/.hbase-snapshot/testExportWithTargetName 2023-07-16 01:11:37,337 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469880266/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-16 01:11:37,337 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469880266/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-16 01:11:37,349 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-16 01:11:37,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-16 01:11:37,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:37,369 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469897369"}]},"ts":"1689469897369"} 2023-07-16 01:11:37,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 01:11:37,371 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-16 01:11:37,374 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-16 01:11:37,377 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be4307162dff301d0ecf4892b2ea3bba, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b3b58d0c7639e2b5c812cd74a9fd1a44, UNASSIGN}] 2023-07-16 01:11:37,379 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be4307162dff301d0ecf4892b2ea3bba, UNASSIGN 2023-07-16 01:11:37,379 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b3b58d0c7639e2b5c812cd74a9fd1a44, UNASSIGN 2023-07-16 01:11:37,380 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b3b58d0c7639e2b5c812cd74a9fd1a44, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:37,380 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=be4307162dff301d0ecf4892b2ea3bba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:37,380 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469897380"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469897380"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469897380"}]},"ts":"1689469897380"} 2023-07-16 01:11:37,380 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469897380"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469897380"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469897380"}]},"ts":"1689469897380"} 2023-07-16 01:11:37,382 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure b3b58d0c7639e2b5c812cd74a9fd1a44, server=jenkins-hbase4.apache.org,41029,1689469866571}] 2023-07-16 01:11:37,386 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure be4307162dff301d0ecf4892b2ea3bba, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:11:37,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 01:11:37,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:37,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:37,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing be4307162dff301d0ecf4892b2ea3bba, disabling compactions & flushes 2023-07-16 01:11:37,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b3b58d0c7639e2b5c812cd74a9fd1a44, disabling compactions & flushes 2023-07-16 01:11:37,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:37,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:37,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:37,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:37,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. after waiting 0 ms 2023-07-16 01:11:37,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. after waiting 0 ms 2023-07-16 01:11:37,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:37,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:37,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:11:37,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:37,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba. 2023-07-16 01:11:37,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for be4307162dff301d0ecf4892b2ea3bba: 2023-07-16 01:11:37,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:11:37,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:37,571 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=be4307162dff301d0ecf4892b2ea3bba, regionState=CLOSED 2023-07-16 01:11:37,571 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469897571"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469897571"}]},"ts":"1689469897571"} 2023-07-16 01:11:37,576 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-16 01:11:37,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure be4307162dff301d0ecf4892b2ea3bba, server=jenkins-hbase4.apache.org,45775,1689469866515 in 187 msec 2023-07-16 01:11:37,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be4307162dff301d0ecf4892b2ea3bba, UNASSIGN in 201 msec 2023-07-16 01:11:37,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:37,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44. 2023-07-16 01:11:37,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b3b58d0c7639e2b5c812cd74a9fd1a44: 2023-07-16 01:11:37,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:37,587 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b3b58d0c7639e2b5c812cd74a9fd1a44, regionState=CLOSED 2023-07-16 01:11:37,588 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689469897587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469897587"}]},"ts":"1689469897587"} 2023-07-16 01:11:37,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-16 01:11:37,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure b3b58d0c7639e2b5c812cd74a9fd1a44, server=jenkins-hbase4.apache.org,41029,1689469866571 in 208 msec 2023-07-16 01:11:37,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-16 01:11:37,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b3b58d0c7639e2b5c812cd74a9fd1a44, UNASSIGN in 219 msec 2023-07-16 01:11:37,599 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469897599"}]},"ts":"1689469897599"} 2023-07-16 01:11:37,602 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-16 01:11:37,604 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-16 01:11:37,608 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 249 msec 2023-07-16 01:11:37,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 01:11:37,674 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-16 01:11:37,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-16 01:11:37,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:37,693 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:37,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-16 01:11:37,695 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:37,699 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-16 01:11:37,702 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:37,702 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:37,702 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:37,703 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:37,703 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:37,703 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:37,703 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 01:11:37,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 01:11:37,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 01:11:37,706 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:37,706 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:37,706 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:37,706 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:37,706 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:37,707 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 01:11:37,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-16 01:11:37,707 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 01:11:37,707 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:37,709 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/recovered.edits] 2023-07-16 01:11:37,709 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/recovered.edits] 2023-07-16 01:11:37,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 01:11:37,716 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/cf/50c63d6edeab456997794919d74884bb to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/cf/50c63d6edeab456997794919d74884bb 2023-07-16 01:11:37,716 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/cf/d571893c50fb4e99b5179b49ff344e9c to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/cf/d571893c50fb4e99b5179b49ff344e9c 2023-07-16 01:11:37,720 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/recovered.edits/9.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba/recovered.edits/9.seqid 2023-07-16 01:11:37,720 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/recovered.edits/9.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44/recovered.edits/9.seqid 2023-07-16 01:11:37,721 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/be4307162dff301d0ecf4892b2ea3bba 2023-07-16 01:11:37,721 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportWithTargetName/b3b58d0c7639e2b5c812cd74a9fd1a44 2023-07-16 01:11:37,721 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 01:11:37,724 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:37,747 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-16 01:11:37,750 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-16 01:11:37,752 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:37,752 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-16 01:11:37,752 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469897752"}]},"ts":"9223372036854775807"} 2023-07-16 01:11:37,752 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469897752"}]},"ts":"9223372036854775807"} 2023-07-16 01:11:37,754 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 01:11:37,755 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => be4307162dff301d0ecf4892b2ea3bba, NAME => 'testtb-testExportWithTargetName,,1689469877206.be4307162dff301d0ecf4892b2ea3bba.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b3b58d0c7639e2b5c812cd74a9fd1a44, NAME => 'testtb-testExportWithTargetName,1,1689469877206.b3b58d0c7639e2b5c812cd74a9fd1a44.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 01:11:37,755 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-16 01:11:37,755 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689469897755"}]},"ts":"9223372036854775807"} 2023-07-16 01:11:37,757 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-16 01:11:37,759 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 01:11:37,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 77 msec 2023-07-16 01:11:37,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 01:11:37,811 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-16 01:11:37,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-16 01:11:37,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-16 01:11:37,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-16 01:11:37,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-16 01:11:37,880 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=755 (was 705) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:44795 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:35388 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:35149 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-351647069_1 at /127.0.0.1:35368 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-351647069_1 at /127.0.0.1:53516 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:41553 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:53530 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:39080 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=306 (was 290) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=2941 (was 4744) 2023-07-16 01:11:37,880 WARN [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-16 01:11:37,904 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=306, ProcessCount=182, AvailableMemoryMB=2940 2023-07-16 01:11:37,904 WARN [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-16 01:11:37,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 01:11:37,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:37,914 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:11:37,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-16 01:11:37,915 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:11:37,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 01:11:37,919 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:37,919 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:37,919 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd empty. 2023-07-16 01:11:37,920 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440 empty. 2023-07-16 01:11:37,920 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:37,920 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:37,920 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 01:11:37,949 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:37,951 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 934ff93e214a3e8bfe646da22d0375dd, NAME => 'testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:11:37,951 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => dddfea080654eb0922c8d5123a70d440, NAME => 'testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:11:37,983 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing dddfea080654eb0922c8d5123a70d440, disabling compactions & flushes 2023-07-16 01:11:37,984 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. after waiting 0 ms 2023-07-16 01:11:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:37,984 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for dddfea080654eb0922c8d5123a70d440: 2023-07-16 01:11:38,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 01:11:38,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 01:11:38,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:38,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 934ff93e214a3e8bfe646da22d0375dd, disabling compactions & flushes 2023-07-16 01:11:38,382 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:38,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:38,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. after waiting 0 ms 2023-07-16 01:11:38,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:38,382 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:38,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 934ff93e214a3e8bfe646da22d0375dd: 2023-07-16 01:11:38,385 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:11:38,387 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469898387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469898387"}]},"ts":"1689469898387"} 2023-07-16 01:11:38,387 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469898387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469898387"}]},"ts":"1689469898387"} 2023-07-16 01:11:38,391 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:11:38,392 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:11:38,393 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469898392"}]},"ts":"1689469898392"} 2023-07-16 01:11:38,395 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 01:11:38,400 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:11:38,402 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:11:38,402 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:11:38,402 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:11:38,402 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:11:38,402 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=934ff93e214a3e8bfe646da22d0375dd, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dddfea080654eb0922c8d5123a70d440, ASSIGN}] 2023-07-16 01:11:38,406 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=934ff93e214a3e8bfe646da22d0375dd, ASSIGN 2023-07-16 01:11:38,407 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dddfea080654eb0922c8d5123a70d440, ASSIGN 2023-07-16 01:11:38,409 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=934ff93e214a3e8bfe646da22d0375dd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39681,1689469866446; forceNewPlan=false, retain=false 2023-07-16 01:11:38,409 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dddfea080654eb0922c8d5123a70d440, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45775,1689469866515; forceNewPlan=false, retain=false 2023-07-16 01:11:38,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 01:11:38,559 INFO [jenkins-hbase4:39271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:11:38,563 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=dddfea080654eb0922c8d5123a70d440, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:38,563 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=934ff93e214a3e8bfe646da22d0375dd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:38,563 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469898562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469898562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469898562"}]},"ts":"1689469898562"} 2023-07-16 01:11:38,563 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469898562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469898562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469898562"}]},"ts":"1689469898562"} 2023-07-16 01:11:38,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure dddfea080654eb0922c8d5123a70d440, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:11:38,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 934ff93e214a3e8bfe646da22d0375dd, server=jenkins-hbase4.apache.org,39681,1689469866446}] 2023-07-16 01:11:38,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:38,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dddfea080654eb0922c8d5123a70d440, NAME => 'testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 01:11:38,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. service=AccessControlService 2023-07-16 01:11:38,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:38,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:38,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:38,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:38,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:38,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:38,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 934ff93e214a3e8bfe646da22d0375dd, NAME => 'testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 01:11:38,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. service=AccessControlService 2023-07-16 01:11:38,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:38,730 INFO [StoreOpener-dddfea080654eb0922c8d5123a70d440-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:38,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:38,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:38,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:38,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:38,731 DEBUG [StoreOpener-dddfea080654eb0922c8d5123a70d440-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/cf 2023-07-16 01:11:38,731 DEBUG [StoreOpener-dddfea080654eb0922c8d5123a70d440-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/cf 2023-07-16 01:11:38,732 INFO [StoreOpener-934ff93e214a3e8bfe646da22d0375dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:38,732 INFO [StoreOpener-dddfea080654eb0922c8d5123a70d440-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dddfea080654eb0922c8d5123a70d440 columnFamilyName cf 2023-07-16 01:11:38,733 INFO [StoreOpener-dddfea080654eb0922c8d5123a70d440-1] regionserver.HStore(310): Store=dddfea080654eb0922c8d5123a70d440/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:38,733 DEBUG [StoreOpener-934ff93e214a3e8bfe646da22d0375dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/cf 2023-07-16 01:11:38,734 DEBUG [StoreOpener-934ff93e214a3e8bfe646da22d0375dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/cf 2023-07-16 01:11:38,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:38,735 INFO [StoreOpener-934ff93e214a3e8bfe646da22d0375dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 934ff93e214a3e8bfe646da22d0375dd columnFamilyName cf 2023-07-16 01:11:38,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:38,735 INFO [StoreOpener-934ff93e214a3e8bfe646da22d0375dd-1] regionserver.HStore(310): Store=934ff93e214a3e8bfe646da22d0375dd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:38,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:38,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:38,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:38,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:38,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:38,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dddfea080654eb0922c8d5123a70d440; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60730456, jitterRate=-0.09504568576812744}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:38,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dddfea080654eb0922c8d5123a70d440: 2023-07-16 01:11:38,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440., pid=30, masterSystemTime=1689469898719 2023-07-16 01:11:38,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:38,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 934ff93e214a3e8bfe646da22d0375dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70374794, jitterRate=0.048666149377822876}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:38,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 934ff93e214a3e8bfe646da22d0375dd: 2023-07-16 01:11:38,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:38,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:38,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd., pid=31, masterSystemTime=1689469898721 2023-07-16 01:11:38,746 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=dddfea080654eb0922c8d5123a70d440, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:38,746 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469898746"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469898746"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469898746"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469898746"}]},"ts":"1689469898746"} 2023-07-16 01:11:38,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:38,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:38,748 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=934ff93e214a3e8bfe646da22d0375dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:38,749 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469898748"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469898748"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469898748"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469898748"}]},"ts":"1689469898748"} 2023-07-16 01:11:38,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-16 01:11:38,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure dddfea080654eb0922c8d5123a70d440, server=jenkins-hbase4.apache.org,45775,1689469866515 in 182 msec 2023-07-16 01:11:38,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dddfea080654eb0922c8d5123a70d440, ASSIGN in 350 msec 2023-07-16 01:11:38,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-16 01:11:38,755 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 934ff93e214a3e8bfe646da22d0375dd, server=jenkins-hbase4.apache.org,39681,1689469866446 in 184 msec 2023-07-16 01:11:38,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-16 01:11:38,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=934ff93e214a3e8bfe646da22d0375dd, ASSIGN in 353 msec 2023-07-16 01:11:38,758 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:11:38,759 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469898759"}]},"ts":"1689469898759"} 2023-07-16 01:11:38,760 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 01:11:38,766 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:11:38,766 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-16 01:11:38,768 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 01:11:38,770 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:38,770 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:38,770 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:38,770 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:38,771 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:38,771 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:38,771 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:38,772 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:38,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 862 msec 2023-07-16 01:11:38,846 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-16 01:11:39,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 01:11:39,023 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-16 01:11:39,023 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-16 01:11:39,023 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:39,027 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-16 01:11:39,028 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:39,028 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-16 01:11:39,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:11:39,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469899031 (current time:1689469899031). 2023-07-16 01:11:39,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:11:39,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x3c1f4202 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:39,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50dd37c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:39,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:39,041 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:39,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c1f4202 to 127.0.0.1:64468 2023-07-16 01:11:39,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:39,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x71972400 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:39,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37de7762, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:39,051 DEBUG [hconnection-0xe04357c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:39,054 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:39,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:39,060 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:39,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71972400 to 127.0.0.1:64468 2023-07-16 01:11:39,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:39,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 01:11:39,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:11:39,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:11:39,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:11:39,065 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:11:39,066 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689470499066 2023-07-16 01:11:39,066 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 01:11:39,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:11:39,067 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:11:39,067 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:11:39,069 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:11:39,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 01:11:39,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-16 01:11:39,071 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 01:11:39,072 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689470499072 2023-07-16 01:11:39,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,084 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-16 01:11:39,085 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:39,086 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 01:11:39,086 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 01:11:39,086 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,086 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,088 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:39,088 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:39,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:39,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:39,088 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,088 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:39,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:39,088 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,089 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,089 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,089 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:11:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 01:11:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 01:11:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,090 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 01:11:39,090 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 01:11:39,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 01:11:39,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,090 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 01:11:39,090 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 01:11:39,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,090 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:39,090 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 01:11:39,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,091 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 01:11:39,091 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 01:11:39,091 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:39,091 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 01:11:39,091 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:39,092 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 01:11:39,093 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 01:11:39,093 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 01:11:39,092 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 01:11:39,093 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 01:11:39,093 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 01:11:39,093 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 01:11:39,096 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,099 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,099 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,099 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,099 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:39,099 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,100 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,100 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,100 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,100 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:39,100 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:39,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 01:11:39,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f07c5b4[Count = 1] remaining members to acquire global barrier 2023-07-16 01:11:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:39,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:39,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:39,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 01:11:39,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f07c5b4[Count = 0] remaining members to acquire global barrier 2023-07-16 01:11:39,105 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 01:11:39,105 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,107 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,107 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,107 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:11:39,107 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:11:39,107 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:39,107 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,107 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:11:39,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,107 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:39,108 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. started... 2023-07-16 01:11:39,107 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. started... 2023-07-16 01:11:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,108 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:11:39,109 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 01:11:39,109 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:11:39,109 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dddfea080654eb0922c8d5123a70d440: 2023-07-16 01:11:39,109 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 934ff93e214a3e8bfe646da22d0375dd: 2023-07-16 01:11:39,109 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,109 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,109 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:39,109 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:39,109 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:11:39,109 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:11:39,111 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 01:11:39,111 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:39,111 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 01:11:39,134 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. completed. 2023-07-16 01:11:39,134 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:39,134 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:39,134 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:39,134 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,134 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 01:11:39,134 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:11:39,135 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. completed. 2023-07-16 01:11:39,135 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:39,135 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:39,135 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:39,135 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,135 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 01:11:39,135 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:11:39,137 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 01:11:39,137 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:39,137 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,137 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 01:11:39,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:39,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:39,139 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:39,139 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 01:11:39,139 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:39,139 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 01:11:39,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:39,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:39,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45775,1689469866515': 2023-07-16 01:11:39,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 01:11:39,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:39,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:39,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:39,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:39,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39681,1689469866446': 2023-07-16 01:11:39,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 01:11:39,150 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-16 01:11:39,150 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:11:39,150 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:11:39,150 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,150 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:11:39,152 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,152 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,152 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:39,152 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,152 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,152 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:39,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,152 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:39,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:39,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:39,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,154 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,154 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,155 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:39,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:39,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,157 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,157 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,158 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:39,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,163 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:39,163 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:39,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:39,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:39,163 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,163 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:39,163 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:39,163 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:39,163 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,163 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:39,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:39,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:39,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-16 01:11:39,165 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:39,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:39,163 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,165 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,165 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:39,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:39,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:39,165 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,165 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,166 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,166 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,166 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,166 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,166 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:39,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:39,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:39,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:39,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,167 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:39,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:11:39,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:39,169 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:11:39,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,221 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 01:11:39,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,222 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:39,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689469899066Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689469899165 (+99 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689469899165Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689469899171 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689469899185 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689469899221 (+36 ms) 2023-07-16 01:11:39,224 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 01:11:39,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 158 msec 2023-07-16 01:11:39,369 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:39,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:11:39,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:11:39,382 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:39,385 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:39,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39681] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:11:39,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45775] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:11:39,391 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-16 01:11:39,391 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:39,393 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:39,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:11:39,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469899410 (current time:1689469899410). 2023-07-16 01:11:39,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:11:39,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x6fdf7927 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:39,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f83233c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:39,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:39,422 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:39,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fdf7927 to 127.0.0.1:64468 2023-07-16 01:11:39,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:39,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x637a5a6c to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:39,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41545675, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:39,531 DEBUG [hconnection-0x11ccf79c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:39,532 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:39,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:39,541 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:39,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x637a5a6c to 127.0.0.1:64468 2023-07-16 01:11:39,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:39,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 01:11:39,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:11:39,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:11:39,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:11:39,548 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:11:39,550 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689470499550 2023-07-16 01:11:39,550 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 01:11:39,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:11:39,552 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:11:39,552 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:11:39,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 01:11:39,553 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:11:39,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-16 01:11:39,557 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 01:11:39,563 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689470499563 2023-07-16 01:11:39,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-16 01:11:39,601 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-16 01:11:39,601 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:39,602 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 01:11:39,602 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 01:11:39,603 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,603 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,604 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:39,604 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:39,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:39,604 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:39,604 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:39,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:39,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:39,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:39,605 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:39,605 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,606 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,606 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:11:39,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 01:11:39,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 01:11:39,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,607 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 01:11:39,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,607 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 01:11:39,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 01:11:39,607 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 01:11:39,607 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:39,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 01:11:39,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 01:11:39,607 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 01:11:39,607 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 01:11:39,607 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:39,609 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 01:11:39,609 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 01:11:39,609 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 01:11:39,609 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:39,609 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 01:11:39,609 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 01:11:39,611 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 01:11:39,611 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 01:11:39,611 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 01:11:39,611 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 01:11:39,611 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 01:11:39,611 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 01:11:39,614 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,614 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,614 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,614 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,614 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:39,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:39,615 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,615 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,615 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:39,615 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:39,615 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,615 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:39,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:39,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:39,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:39,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:39,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 01:11:39,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42ee03b4[Count = 1] remaining members to acquire global barrier 2023-07-16 01:11:39,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:39,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:39,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:39,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:39,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:39,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:39,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 01:11:39,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42ee03b4[Count = 0] remaining members to acquire global barrier 2023-07-16 01:11:39,629 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 01:11:39,629 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,631 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,631 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,631 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,631 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,631 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:11:39,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,631 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:11:39,631 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:11:39,631 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 01:11:39,631 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,631 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:11:39,631 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:11:39,631 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:39,631 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:39,632 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:39,632 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:39,632 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. started... 2023-07-16 01:11:39,632 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:39,632 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:39,632 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. started... 2023-07-16 01:11:39,632 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dddfea080654eb0922c8d5123a70d440 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-16 01:11:39,632 INFO [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 934ff93e214a3e8bfe646da22d0375dd 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-16 01:11:39,633 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 01:11:39,633 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:39,633 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 01:11:39,652 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:39,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:11:39,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:39,654 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:11:39,667 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/.tmp/cf/9d010f211d2745e4a0b29b912e29eaa4 2023-07-16 01:11:39,682 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/.tmp/cf/9d010f211d2745e4a0b29b912e29eaa4 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/cf/9d010f211d2745e4a0b29b912e29eaa4 2023-07-16 01:11:39,683 INFO [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/.tmp/cf/bcb47ca0ee3a4dc6ae913c02f420532f 2023-07-16 01:11:39,695 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/cf/9d010f211d2745e4a0b29b912e29eaa4, entries=46, sequenceid=6, filesize=7.9 K 2023-07-16 01:11:39,698 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for dddfea080654eb0922c8d5123a70d440 in 66ms, sequenceid=6, compaction requested=false 2023-07-16 01:11:39,700 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dddfea080654eb0922c8d5123a70d440: 2023-07-16 01:11:39,700 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 01:11:39,700 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:39,700 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/cf/9d010f211d2745e4a0b29b912e29eaa4] hfiles 2023-07-16 01:11:39,701 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/cf/9d010f211d2745e4a0b29b912e29eaa4 for snapshot=snaptb0-testExportFileSystemState 2023-07-16 01:11:39,702 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/.tmp/cf/bcb47ca0ee3a4dc6ae913c02f420532f as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/cf/bcb47ca0ee3a4dc6ae913c02f420532f 2023-07-16 01:11:39,712 INFO [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/cf/bcb47ca0ee3a4dc6ae913c02f420532f, entries=4, sequenceid=6, filesize=5.1 K 2023-07-16 01:11:39,715 INFO [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 934ff93e214a3e8bfe646da22d0375dd in 83ms, sequenceid=6, compaction requested=false 2023-07-16 01:11:39,715 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 934ff93e214a3e8bfe646da22d0375dd: 2023-07-16 01:11:39,716 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 01:11:39,716 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:39,716 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/cf/bcb47ca0ee3a4dc6ae913c02f420532f] hfiles 2023-07-16 01:11:39,716 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/cf/bcb47ca0ee3a4dc6ae913c02f420532f for snapshot=snaptb0-testExportFileSystemState 2023-07-16 01:11:39,739 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. completed. 2023-07-16 01:11:39,741 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:39,741 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:39,742 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:39,742 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,742 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 01:11:39,742 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:11:39,747 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. completed. 2023-07-16 01:11:39,748 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:39,748 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:39,748 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:39,748 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,748 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 01:11:39,748 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:11:39,749 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 01:11:39,749 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,749 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:39,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:39,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:39,752 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,752 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 01:11:39,749 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 01:11:39,755 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:39,755 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 01:11:39,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:39,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:39,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:39,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:39,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:39,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45775,1689469866515': 2023-07-16 01:11:39,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 01:11:39,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:39,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:39,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:39,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:39,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:39,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:39,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39681,1689469866446': 2023-07-16 01:11:39,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 01:11:39,772 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-16 01:11:39,772 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:11:39,772 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:11:39,772 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-16 01:11:39,772 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:11:39,774 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,774 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,774 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,774 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:39,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:39,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:39,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,774 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,774 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:39,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,774 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:39,775 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:39,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:39,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:39,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:39,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:39,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:39,775 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:39,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,776 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:39,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:39,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:39,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,779 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:39,780 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 01:11:39,780 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,784 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:39,784 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:39,784 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:39,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:39,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:39,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:39,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:39,784 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:39,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:39,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:39,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-16 01:11:39,784 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:39,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-16 01:11:39,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:39,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:39,785 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:39,784 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:39,787 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:39,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:39,787 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:39,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:39,787 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,787 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,787 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,787 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:39,787 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,787 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:39,787 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:39,787 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,787 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,854 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:39,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:11:39,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:39,856 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:11:39,861 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 01:11:39,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,861 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 01:11:39,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689469899550Consolidate snapshot: snaptb0-testExportFileSystemState at 1689469899785 (+235 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689469899785Writing data manifest for snaptb0-testExportFileSystemState at 1689469899792 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689469899812 (+20 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689469899861 (+49 ms) 2023-07-16 01:11:39,864 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 01:11:39,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 313 msec 2023-07-16 01:11:40,156 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:40,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:11:40,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:11:40,159 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469900159 2023-07-16 01:11:40,159 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40869, tgtDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469900159, rawTgtDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469900159, srcFsUri=hdfs://localhost:40869, srcDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:11:40,183 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:11:40,183 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1262624146_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469900159, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469900159/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 01:11:40,183 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5, snapshotDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-16 01:11:40,196 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469900159/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 01:11:40,231 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:40,231 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:40,231 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:40,232 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:41,140 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-8889677275759374837.jar 2023-07-16 01:11:41,141 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:41,141 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:41,216 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-918544965309586789.jar 2023-07-16 01:11:41,217 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:41,217 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:41,218 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:41,218 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:41,219 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:41,219 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:41,219 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:11:41,220 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:11:41,220 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:11:41,221 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:11:41,221 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:11:41,221 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:11:41,222 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:11:41,222 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:11:41,222 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:11:41,223 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:11:41,224 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:41,224 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:41,225 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:41,225 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:41,225 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:41,226 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:41,226 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:41,712 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0001_000001 (auth:SIMPLE) 2023-07-16 01:11:41,851 WARN [Listener at jenkins-hbase4.apache.org/39957] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:11:41,854 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-16 01:11:41,856 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 01:11:42,015 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:11:42,015 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:11:42,477 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0002_000001 (auth:SIMPLE) 2023-07-16 01:11:43,184 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:11:47,385 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0002_000001 (auth:SIMPLE) 2023-07-16 01:11:49,632 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0002_000001 (auth:SIMPLE) 2023-07-16 01:11:54,130 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:11:54,133 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:11:54,142 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-16 01:11:54,142 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:11:54,142 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:11:54,142 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1398488159_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 01:11:54,143 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 01:11:54,143 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 01:11:54,143 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1398488159_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469900159/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469900159/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 01:11:54,144 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469900159/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 01:11:54,144 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469900159/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 01:11:54,151 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-16 01:11:54,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-16 01:11:54,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:54,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 01:11:54,156 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469914156"}]},"ts":"1689469914156"} 2023-07-16 01:11:54,157 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 01:11:54,159 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-16 01:11:54,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=934ff93e214a3e8bfe646da22d0375dd, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dddfea080654eb0922c8d5123a70d440, UNASSIGN}] 2023-07-16 01:11:54,162 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dddfea080654eb0922c8d5123a70d440, UNASSIGN 2023-07-16 01:11:54,162 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=934ff93e214a3e8bfe646da22d0375dd, UNASSIGN 2023-07-16 01:11:54,163 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=dddfea080654eb0922c8d5123a70d440, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:54,163 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=934ff93e214a3e8bfe646da22d0375dd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:54,163 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469914163"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469914163"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469914163"}]},"ts":"1689469914163"} 2023-07-16 01:11:54,163 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469914163"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469914163"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469914163"}]},"ts":"1689469914163"} 2023-07-16 01:11:54,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure dddfea080654eb0922c8d5123a70d440, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:11:54,166 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 934ff93e214a3e8bfe646da22d0375dd, server=jenkins-hbase4.apache.org,39681,1689469866446}] 2023-07-16 01:11:54,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 01:11:54,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:54,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dddfea080654eb0922c8d5123a70d440, disabling compactions & flushes 2023-07-16 01:11:54,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:54,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:54,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:54,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. after waiting 0 ms 2023-07-16 01:11:54,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 934ff93e214a3e8bfe646da22d0375dd, disabling compactions & flushes 2023-07-16 01:11:54,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:54,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:54,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:54,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. after waiting 0 ms 2023-07-16 01:11:54,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:54,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:11:54,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:54,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440. 2023-07-16 01:11:54,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dddfea080654eb0922c8d5123a70d440: 2023-07-16 01:11:54,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:54,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:11:54,343 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=dddfea080654eb0922c8d5123a70d440, regionState=CLOSED 2023-07-16 01:11:54,343 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469914343"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469914343"}]},"ts":"1689469914343"} 2023-07-16 01:11:54,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:11:54,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd. 2023-07-16 01:11:54,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 934ff93e214a3e8bfe646da22d0375dd: 2023-07-16 01:11:54,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:54,347 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=934ff93e214a3e8bfe646da22d0375dd, regionState=CLOSED 2023-07-16 01:11:54,348 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689469914347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469914347"}]},"ts":"1689469914347"} 2023-07-16 01:11:54,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-16 01:11:54,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure dddfea080654eb0922c8d5123a70d440, server=jenkins-hbase4.apache.org,45775,1689469866515 in 182 msec 2023-07-16 01:11:54,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-16 01:11:54,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 934ff93e214a3e8bfe646da22d0375dd, server=jenkins-hbase4.apache.org,39681,1689469866446 in 183 msec 2023-07-16 01:11:54,352 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=dddfea080654eb0922c8d5123a70d440, UNASSIGN in 190 msec 2023-07-16 01:11:54,354 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-16 01:11:54,354 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=934ff93e214a3e8bfe646da22d0375dd, UNASSIGN in 192 msec 2023-07-16 01:11:54,355 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469914354"}]},"ts":"1689469914354"} 2023-07-16 01:11:54,356 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 01:11:54,357 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-16 01:11:54,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 207 msec 2023-07-16 01:11:54,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 01:11:54,458 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-16 01:11:54,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-16 01:11:54,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:54,464 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:54,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-16 01:11:54,465 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:54,466 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-16 01:11:54,469 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:54,469 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:54,469 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:54,470 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 01:11:54,470 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 01:11:54,470 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 01:11:54,471 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:54,474 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:54,474 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:54,476 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/recovered.edits] 2023-07-16 01:11:54,476 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/recovered.edits] 2023-07-16 01:11:54,477 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:54,477 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:54,477 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:54,477 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:54,477 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 01:11:54,477 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:54,477 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:54,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 01:11:54,477 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-16 01:11:54,480 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 01:11:54,484 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/cf/9d010f211d2745e4a0b29b912e29eaa4 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/cf/9d010f211d2745e4a0b29b912e29eaa4 2023-07-16 01:11:54,486 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/cf/bcb47ca0ee3a4dc6ae913c02f420532f to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/cf/bcb47ca0ee3a4dc6ae913c02f420532f 2023-07-16 01:11:54,489 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/recovered.edits/9.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440/recovered.edits/9.seqid 2023-07-16 01:11:54,489 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/recovered.edits/9.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd/recovered.edits/9.seqid 2023-07-16 01:11:54,490 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/dddfea080654eb0922c8d5123a70d440 2023-07-16 01:11:54,490 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemState/934ff93e214a3e8bfe646da22d0375dd 2023-07-16 01:11:54,490 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 01:11:54,492 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:54,495 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-16 01:11:54,497 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-16 01:11:54,498 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:54,498 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-16 01:11:54,498 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469914498"}]},"ts":"9223372036854775807"} 2023-07-16 01:11:54,498 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469914498"}]},"ts":"9223372036854775807"} 2023-07-16 01:11:54,500 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 01:11:54,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 934ff93e214a3e8bfe646da22d0375dd, NAME => 'testtb-testExportFileSystemState,,1689469897907.934ff93e214a3e8bfe646da22d0375dd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dddfea080654eb0922c8d5123a70d440, NAME => 'testtb-testExportFileSystemState,1,1689469897907.dddfea080654eb0922c8d5123a70d440.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 01:11:54,501 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-16 01:11:54,501 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689469914501"}]},"ts":"9223372036854775807"} 2023-07-16 01:11:54,503 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-16 01:11:54,504 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 01:11:54,506 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 44 msec 2023-07-16 01:11:54,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 01:11:54,580 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-16 01:11:54,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-16 01:11:54,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-16 01:11:54,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-16 01:11:54,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-16 01:11:54,624 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=765 (was 755) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:45132 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2066 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_712345669_1 at /127.0.0.1:45120 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:35267 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:38842 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_712345669_1 at /127.0.0.1:46920 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:46938 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=419 (was 306) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=2838 (was 2940) 2023-07-16 01:11:54,625 WARN [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-16 01:11:54,651 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=419, ProcessCount=182, AvailableMemoryMB=2837 2023-07-16 01:11:54,651 WARN [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-16 01:11:54,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 01:11:54,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:11:54,657 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:11:54,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-16 01:11:54,659 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:11:54,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 01:11:54,662 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:11:54,662 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:11:54,663 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3 empty. 2023-07-16 01:11:54,663 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba empty. 2023-07-16 01:11:54,663 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:11:54,663 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:11:54,664 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 01:11:54,684 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-16 01:11:54,685 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9aa3c4d8f823d1cbbb86f6a892020aba, NAME => 'testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:11:54,686 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5294a8c7c3cb550d0a0b122eb741aac3, NAME => 'testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:11:54,729 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:54,729 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:54,729 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 9aa3c4d8f823d1cbbb86f6a892020aba, disabling compactions & flushes 2023-07-16 01:11:54,729 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 5294a8c7c3cb550d0a0b122eb741aac3, disabling compactions & flushes 2023-07-16 01:11:54,729 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:11:54,729 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:11:54,729 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:11:54,729 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:11:54,729 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. after waiting 0 ms 2023-07-16 01:11:54,729 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. after waiting 0 ms 2023-07-16 01:11:54,729 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:11:54,729 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:11:54,730 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:11:54,730 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:11:54,730 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 9aa3c4d8f823d1cbbb86f6a892020aba: 2023-07-16 01:11:54,730 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 5294a8c7c3cb550d0a0b122eb741aac3: 2023-07-16 01:11:54,735 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:11:54,736 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469914736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469914736"}]},"ts":"1689469914736"} 2023-07-16 01:11:54,737 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469914736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469914736"}]},"ts":"1689469914736"} 2023-07-16 01:11:54,739 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:11:54,741 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:11:54,741 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469914741"}]},"ts":"1689469914741"} 2023-07-16 01:11:54,742 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-16 01:11:54,746 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:11:54,748 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:11:54,748 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:11:54,748 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:11:54,748 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:11:54,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9aa3c4d8f823d1cbbb86f6a892020aba, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5294a8c7c3cb550d0a0b122eb741aac3, ASSIGN}] 2023-07-16 01:11:54,751 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9aa3c4d8f823d1cbbb86f6a892020aba, ASSIGN 2023-07-16 01:11:54,751 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5294a8c7c3cb550d0a0b122eb741aac3, ASSIGN 2023-07-16 01:11:54,752 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9aa3c4d8f823d1cbbb86f6a892020aba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41029,1689469866571; forceNewPlan=false, retain=false 2023-07-16 01:11:54,752 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5294a8c7c3cb550d0a0b122eb741aac3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45775,1689469866515; forceNewPlan=false, retain=false 2023-07-16 01:11:54,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 01:11:54,903 INFO [jenkins-hbase4:39271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:11:54,906 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9aa3c4d8f823d1cbbb86f6a892020aba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:54,906 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5294a8c7c3cb550d0a0b122eb741aac3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:54,906 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469914906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469914906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469914906"}]},"ts":"1689469914906"} 2023-07-16 01:11:54,906 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469914906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469914906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469914906"}]},"ts":"1689469914906"} 2023-07-16 01:11:54,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 9aa3c4d8f823d1cbbb86f6a892020aba, server=jenkins-hbase4.apache.org,41029,1689469866571}] 2023-07-16 01:11:54,910 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 5294a8c7c3cb550d0a0b122eb741aac3, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:11:54,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 01:11:55,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:11:55,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9aa3c4d8f823d1cbbb86f6a892020aba, NAME => 'testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 01:11:55,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:11:55,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5294a8c7c3cb550d0a0b122eb741aac3, NAME => 'testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 01:11:55,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. service=AccessControlService 2023-07-16 01:11:55,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. service=AccessControlService 2023-07-16 01:11:55,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:55,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:11:55,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:11:55,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:55,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:11:55,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:11:55,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:11:55,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:11:55,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:11:55,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:11:55,071 INFO [StoreOpener-9aa3c4d8f823d1cbbb86f6a892020aba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:11:55,072 INFO [StoreOpener-5294a8c7c3cb550d0a0b122eb741aac3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:11:55,073 DEBUG [StoreOpener-5294a8c7c3cb550d0a0b122eb741aac3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/cf 2023-07-16 01:11:55,073 DEBUG [StoreOpener-9aa3c4d8f823d1cbbb86f6a892020aba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/cf 2023-07-16 01:11:55,073 DEBUG [StoreOpener-5294a8c7c3cb550d0a0b122eb741aac3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/cf 2023-07-16 01:11:55,073 DEBUG [StoreOpener-9aa3c4d8f823d1cbbb86f6a892020aba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/cf 2023-07-16 01:11:55,074 INFO [StoreOpener-5294a8c7c3cb550d0a0b122eb741aac3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5294a8c7c3cb550d0a0b122eb741aac3 columnFamilyName cf 2023-07-16 01:11:55,074 INFO [StoreOpener-9aa3c4d8f823d1cbbb86f6a892020aba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aa3c4d8f823d1cbbb86f6a892020aba columnFamilyName cf 2023-07-16 01:11:55,074 INFO [StoreOpener-9aa3c4d8f823d1cbbb86f6a892020aba-1] regionserver.HStore(310): Store=9aa3c4d8f823d1cbbb86f6a892020aba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:55,074 INFO [StoreOpener-5294a8c7c3cb550d0a0b122eb741aac3-1] regionserver.HStore(310): Store=5294a8c7c3cb550d0a0b122eb741aac3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:11:55,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:11:55,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:11:55,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:11:55,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:11:55,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:11:55,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:11:55,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:55,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:11:55,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5294a8c7c3cb550d0a0b122eb741aac3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64555106, jitterRate=-0.038053959608078}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:55,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5294a8c7c3cb550d0a0b122eb741aac3: 2023-07-16 01:11:55,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9aa3c4d8f823d1cbbb86f6a892020aba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73402972, jitterRate=0.09378951787948608}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:11:55,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9aa3c4d8f823d1cbbb86f6a892020aba: 2023-07-16 01:11:55,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3., pid=46, masterSystemTime=1689469915065 2023-07-16 01:11:55,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba., pid=45, masterSystemTime=1689469915062 2023-07-16 01:11:55,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:11:55,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:11:55,085 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5294a8c7c3cb550d0a0b122eb741aac3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:11:55,085 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469915085"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469915085"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469915085"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469915085"}]},"ts":"1689469915085"} 2023-07-16 01:11:55,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:11:55,085 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9aa3c4d8f823d1cbbb86f6a892020aba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,086 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469915085"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469915085"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469915085"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469915085"}]},"ts":"1689469915085"} 2023-07-16 01:11:55,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-16 01:11:55,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 5294a8c7c3cb550d0a0b122eb741aac3, server=jenkins-hbase4.apache.org,45775,1689469866515 in 177 msec 2023-07-16 01:11:55,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-16 01:11:55,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 9aa3c4d8f823d1cbbb86f6a892020aba, server=jenkins-hbase4.apache.org,41029,1689469866571 in 179 msec 2023-07-16 01:11:55,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5294a8c7c3cb550d0a0b122eb741aac3, ASSIGN in 341 msec 2023-07-16 01:11:55,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-16 01:11:55,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9aa3c4d8f823d1cbbb86f6a892020aba, ASSIGN in 342 msec 2023-07-16 01:11:55,093 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:11:55,093 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469915093"}]},"ts":"1689469915093"} 2023-07-16 01:11:55,094 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-16 01:11:55,096 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:11:55,097 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-16 01:11:55,098 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 01:11:55,100 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:55,100 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:55,100 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:55,100 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:11:55,101 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:55,102 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:55,102 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:55,102 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 01:11:55,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 448 msec 2023-07-16 01:11:55,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 01:11:55,263 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-16 01:11:55,264 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-16 01:11:55,264 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:55,267 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-16 01:11:55,267 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:55,267 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-16 01:11:55,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 01:11:55,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469915270 (current time:1689469915270). 2023-07-16 01:11:55,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:11:55,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x0d636491 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:55,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a5a8ed7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:55,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:55,282 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:55,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d636491 to 127.0.0.1:64468 2023-07-16 01:11:55,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:55,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x0190baaa to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:55,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@174111e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:55,291 DEBUG [hconnection-0x59a319ec-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:55,294 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:55,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:55,299 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:55,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0190baaa to 127.0.0.1:64468 2023-07-16 01:11:55,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:55,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 01:11:55,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:11:55,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 01:11:55,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 01:11:55,305 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 01:11:55,305 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689470515305 2023-07-16 01:11:55,305 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 01:11:55,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 01:11:55,307 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:11:55,307 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:11:55,308 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 01:11:55,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 01:11:55,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-16 01:11:55,310 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 01:11:55,311 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689470515311 2023-07-16 01:11:55,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,323 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-16 01:11:55,323 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:55,324 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 01:11:55,324 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 01:11:55,325 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,325 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,326 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:55,326 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,326 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:55,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:55,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:55,326 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:55,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:55,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:55,326 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,327 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,327 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,327 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:11:55,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 01:11:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 01:11:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,328 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 01:11:55,328 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 01:11:55,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,328 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 01:11:55,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,328 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:55,328 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 01:11:55,329 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 01:11:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,331 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 01:11:55,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,332 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 01:11:55,332 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 01:11:55,332 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:55,332 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 01:11:55,336 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 01:11:55,336 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 01:11:55,337 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 01:11:55,332 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 01:11:55,336 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 01:11:55,337 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 01:11:55,337 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 01:11:55,338 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,338 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,338 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:55,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:55,339 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,339 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,339 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,339 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:55,339 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,339 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:55,339 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,339 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:55,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:55,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 01:11:55,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18a21785[Count = 1] remaining members to acquire global barrier 2023-07-16 01:11:55,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:55,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:55,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:55,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:55,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:55,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 01:11:55,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18a21785[Count = 0] remaining members to acquire global barrier 2023-07-16 01:11:55,344 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 01:11:55,344 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,347 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,347 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,347 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,347 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 01:11:55,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,347 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,347 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 01:11:55,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,347 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:55,347 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 01:11:55,347 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:55,347 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:55,347 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 01:11:55,347 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:11:55,347 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,348 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:11:55,347 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:55,348 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:11:55,347 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:11:55,348 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. started... 2023-07-16 01:11:55,348 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. started... 2023-07-16 01:11:55,350 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9aa3c4d8f823d1cbbb86f6a892020aba: 2023-07-16 01:11:55,350 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5294a8c7c3cb550d0a0b122eb741aac3: 2023-07-16 01:11:55,350 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,350 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:55,350 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,350 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:11:55,350 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:55,351 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:11:55,354 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 01:11:55,354 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:55,354 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 01:11:55,374 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. completed. 2023-07-16 01:11:55,374 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:11:55,374 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:55,374 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:55,374 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,375 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 01:11:55,375 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:11:55,376 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,377 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 01:11:55,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:55,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:55,377 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:55,377 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 01:11:55,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:55,379 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. completed. 2023-07-16 01:11:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,379 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:11:55,379 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:55,380 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:55,380 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,380 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 01:11:55,380 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:11:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,382 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 01:11:55,382 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:55,382 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,382 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 01:11:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:55,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41029,1689469866571': 2023-07-16 01:11:55,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 01:11:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45775,1689469866515': 2023-07-16 01:11:55,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 01:11:55,391 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-16 01:11:55,391 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:11:55,391 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:11:55,391 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,391 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:11:55,392 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,392 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,392 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,392 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,392 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:55,392 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:55,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:55,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:55,393 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,392 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:55,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:55,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:55,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:55,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:55,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:55,394 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,395 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:55,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,397 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:55,397 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,398 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,401 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,401 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,401 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:55,401 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:55,401 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:55,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:55,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:55,401 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,401 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:55,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:55,402 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:55,401 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:55,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:55,401 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:55,401 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:55,403 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:55,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:55,402 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:55,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:55,403 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,404 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,404 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,404 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,404 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,404 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:55,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:55,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,407 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:55,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 01:11:55,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:55,409 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:11:55,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 01:11:55,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,480 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 01:11:55,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689469915306Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689469915404 (+98 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689469915404Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689469915408 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689469915437 (+29 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689469915479 (+42 ms) 2023-07-16 01:11:55,486 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 01:11:55,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 181 msec 2023-07-16 01:11:55,609 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:55,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 01:11:55,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:11:55,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41029] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:11:55,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45775] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:11:55,621 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-16 01:11:55,621 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:11:55,623 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:11:55,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 01:11:55,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469915635 (current time:1689469915635). 2023-07-16 01:11:55,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:11:55,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x45d6c389 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:55,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a250e9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:55,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:55,650 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:55,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45d6c389 to 127.0.0.1:64468 2023-07-16 01:11:55,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:55,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x23cf136b to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:11:55,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50764610, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:11:55,659 DEBUG [hconnection-0x7285eb65-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:55,662 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:55,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:11:55,667 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:11:55,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23cf136b to 127.0.0.1:64468 2023-07-16 01:11:55,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:11:55,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 01:11:55,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:11:55,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 01:11:55,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 01:11:55,673 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 01:11:55,673 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689470515673 2023-07-16 01:11:55,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 01:11:55,673 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 01:11:55,675 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:11:55,675 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:11:55,676 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 01:11:55,676 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 01:11:55,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-16 01:11:55,678 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 01:11:55,679 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689470515679 2023-07-16 01:11:55,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-16 01:11:55,697 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-16 01:11:55,697 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:55,698 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 01:11:55,698 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 01:11:55,699 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,699 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,700 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:55,700 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:55,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:55,700 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:55,700 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:55,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:55,701 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:55,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,701 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:55,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:55,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,702 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,702 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:11:55,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 01:11:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 01:11:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 01:11:55,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,708 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 01:11:55,708 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 01:11:55,708 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 01:11:55,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 01:11:55,714 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 01:11:55,714 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:55,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 01:11:55,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 01:11:55,716 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 01:11:55,716 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 01:11:55,716 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 01:11:55,716 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:55,716 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:11:55,716 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 01:11:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 01:11:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 01:11:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 01:11:55,717 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 01:11:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 01:11:55,719 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 01:11:55,719 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 01:11:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,722 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,723 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:11:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:55,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 01:11:55,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@623e353[Count = 1] remaining members to acquire global barrier 2023-07-16 01:11:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:55,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 01:11:55,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@623e353[Count = 0] remaining members to acquire global barrier 2023-07-16 01:11:55,727 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 01:11:55,727 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,729 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,729 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,729 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,729 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 01:11:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,729 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 01:11:55,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,729 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:11:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,729 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 01:11:55,729 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 01:11:55,729 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:55,729 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:55,730 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:11:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:11:55,730 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. started... 2023-07-16 01:11:55,730 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:11:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:11:55,730 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. started... 2023-07-16 01:11:55,730 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,730 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5294a8c7c3cb550d0a0b122eb741aac3 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-16 01:11:55,730 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9aa3c4d8f823d1cbbb86f6a892020aba 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-16 01:11:55,731 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 01:11:55,731 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,731 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:11:55,731 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:55,731 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 01:11:55,758 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/.tmp/cf/9b1bf418db9c4399b74fbaf5a208c860 2023-07-16 01:11:55,761 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/.tmp/cf/93075b66af6f4b0382c242b207fd0ece 2023-07-16 01:11:55,766 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/.tmp/cf/9b1bf418db9c4399b74fbaf5a208c860 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/cf/9b1bf418db9c4399b74fbaf5a208c860 2023-07-16 01:11:55,768 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/.tmp/cf/93075b66af6f4b0382c242b207fd0ece as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/cf/93075b66af6f4b0382c242b207fd0ece 2023-07-16 01:11:55,772 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/cf/9b1bf418db9c4399b74fbaf5a208c860, entries=44, sequenceid=6, filesize=7.8 K 2023-07-16 01:11:55,772 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/cf/93075b66af6f4b0382c242b207fd0ece, entries=6, sequenceid=6, filesize=5.2 K 2023-07-16 01:11:55,773 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 5294a8c7c3cb550d0a0b122eb741aac3 in 43ms, sequenceid=6, compaction requested=false 2023-07-16 01:11:55,773 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-16 01:11:55,773 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 9aa3c4d8f823d1cbbb86f6a892020aba in 43ms, sequenceid=6, compaction requested=false 2023-07-16 01:11:55,773 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5294a8c7c3cb550d0a0b122eb741aac3: 2023-07-16 01:11:55,775 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9aa3c4d8f823d1cbbb86f6a892020aba: 2023-07-16 01:11:55,775 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 01:11:55,775 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 01:11:55,775 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:55,775 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:11:55,775 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/cf/9b1bf418db9c4399b74fbaf5a208c860] hfiles 2023-07-16 01:11:55,775 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/cf/93075b66af6f4b0382c242b207fd0ece] hfiles 2023-07-16 01:11:55,775 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/cf/93075b66af6f4b0382c242b207fd0ece for snapshot=snaptb0-testConsecutiveExports 2023-07-16 01:11:55,775 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/cf/9b1bf418db9c4399b74fbaf5a208c860 for snapshot=snaptb0-testConsecutiveExports 2023-07-16 01:11:55,775 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:55,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 01:11:55,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:11:55,777 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:11:55,786 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. completed. 2023-07-16 01:11:55,786 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:11:55,786 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:55,786 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:55,786 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,787 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 01:11:55,787 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:11:55,788 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. completed. 2023-07-16 01:11:55,788 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:11:55,788 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:11:55,788 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:11:55,788 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,788 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 01:11:55,788 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:11:55,790 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,790 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 01:11:55,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:55,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:55,790 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:55,790 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 01:11:55,792 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 01:11:55,792 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:55,792 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:55,792 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 01:11:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41029,1689469866571': 2023-07-16 01:11:55,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 01:11:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:55,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:55,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:55,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:55,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45775,1689469866515': 2023-07-16 01:11:55,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 01:11:55,801 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-16 01:11:55,802 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:11:55,802 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:11:55,802 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-16 01:11:55,802 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:11:55,803 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,803 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:11:55,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:11:55,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,804 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:55,804 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,803 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,804 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:55,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:11:55,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,804 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,804 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:55,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:55,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:55,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:55,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:55,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:55,805 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:55,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:55,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:11:55,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,806 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:55,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:11:55,810 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 01:11:55,810 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,811 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,818 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:55,818 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:55,818 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:11:55,818 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:55,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:55,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:55,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:55,818 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:55,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:55,818 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:11:55,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:11:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:11:55,819 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,819 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,819 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-16 01:11:55,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-16 01:11:55,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:55,819 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:11:55,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:55,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:11:55,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:11:55,819 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,820 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,820 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:11:55,820 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,820 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:11:55,820 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:11:55,820 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,820 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,877 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 01:11:55,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,878 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:11:55,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689469915674Consolidate snapshot: snaptb0-testConsecutiveExports at 1689469915819 (+145 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689469915819Writing data manifest for snaptb0-testConsecutiveExports at 1689469915829 (+10 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689469915841 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689469915877 (+36 ms) 2023-07-16 01:11:55,881 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 01:11:55,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 206 msec 2023-07-16 01:11:55,977 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:11:55,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 01:11:55,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:11:55,979 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978 2023-07-16 01:11:55,979 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978, srcFsUri=hdfs://localhost:40869, srcDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:11:56,009 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:11:56,009 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@77d0ef0, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:11:56,009 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5, snapshotDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 01:11:56,017 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:11:56,030 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,031 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,031 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,031 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,992 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-8545549989259060483.jar 2023-07-16 01:11:56,992 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:56,993 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:57,060 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-1486405201577694120.jar 2023-07-16 01:11:57,060 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:57,061 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:57,061 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:57,062 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:57,062 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:57,062 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:11:57,063 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:11:57,063 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:11:57,063 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:11:57,064 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:11:57,064 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:11:57,065 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:11:57,065 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:11:57,065 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:11:57,066 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:11:57,066 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:11:57,067 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:57,067 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:57,068 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:57,068 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:57,068 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:11:57,069 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:57,070 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:11:57,838 WARN [Listener at jenkins-hbase4.apache.org/39957] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:11:57,840 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 01:11:57,842 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 01:11:58,635 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:11:58,636 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:11:58,638 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0002_000001 (auth:SIMPLE) 2023-07-16 01:11:58,710 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0003_000001 (auth:SIMPLE) 2023-07-16 01:11:59,939 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:12:03,386 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0003_000001 (auth:SIMPLE) 2023-07-16 01:12:05,619 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0003_000001 (auth:SIMPLE) 2023-07-16 01:12:08,994 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0003_000001 (auth:SIMPLE) 2023-07-16 01:12:10,039 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:12:10,039 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:12:10,042 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 01:12:10,042 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:12:10,043 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:12:10,043 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1398488159_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 01:12:10,045 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 01:12:10,046 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 01:12:10,046 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1134b375 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 01:12:10,046 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 01:12:10,046 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 01:12:10,047 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978, srcFsUri=hdfs://localhost:40869, srcDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:12:10,069 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:12:10,069 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7a6357c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:12:10,069 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5, snapshotDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 01:12:10,079 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 01:12:10,090 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:10,091 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:10,091 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:10,091 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:10,983 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-6369630455173583921.jar 2023-07-16 01:12:10,983 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:10,984 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,052 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-3682864536911948869.jar 2023-07-16 01:12:11,053 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,053 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,054 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,055 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,055 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,056 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:11,056 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:12:11,057 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:12:11,057 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:12:11,058 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:12:11,058 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:12:11,058 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:12:11,059 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:12:11,059 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:12:11,059 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:12:11,060 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:12:11,061 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:11,061 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:11,062 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:11,062 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:11,062 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:11,063 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:11,063 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:11,507 WARN [Listener at jenkins-hbase4.apache.org/39957] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:12:11,509 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 01:12:11,511 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 01:12:15,179 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:12:15,179 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:12:15,181 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0003_000001 (auth:SIMPLE) 2023-07-16 01:12:15,907 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0004_000001 (auth:SIMPLE) 2023-07-16 01:12:20,959 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0004_000001 (auth:SIMPLE) 2023-07-16 01:12:23,307 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0004_000001 (auth:SIMPLE) 2023-07-16 01:12:28,641 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0004_000001 (auth:SIMPLE) 2023-07-16 01:12:29,752 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:12:29,752 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:12:29,755 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 01:12:29,756 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:12:29,756 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:12:29,756 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1398488159_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 01:12:29,759 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 01:12:29,759 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 01:12:29,759 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1134b375 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 01:12:29,760 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 01:12:29,760 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/local-export-1689469915978/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 01:12:29,872 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-16 01:12:29,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-16 01:12:29,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:29,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 01:12:29,879 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469949879"}]},"ts":"1689469949879"} 2023-07-16 01:12:29,880 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-16 01:12:29,924 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-16 01:12:29,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9aa3c4d8f823d1cbbb86f6a892020aba, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5294a8c7c3cb550d0a0b122eb741aac3, UNASSIGN}] 2023-07-16 01:12:29,929 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9aa3c4d8f823d1cbbb86f6a892020aba, UNASSIGN 2023-07-16 01:12:29,929 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5294a8c7c3cb550d0a0b122eb741aac3, UNASSIGN 2023-07-16 01:12:29,933 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5294a8c7c3cb550d0a0b122eb741aac3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:29,933 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=9aa3c4d8f823d1cbbb86f6a892020aba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:29,934 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469949933"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469949933"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469949933"}]},"ts":"1689469949933"} 2023-07-16 01:12:29,934 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469949933"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469949933"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469949933"}]},"ts":"1689469949933"} 2023-07-16 01:12:29,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 5294a8c7c3cb550d0a0b122eb741aac3, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:12:29,966 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 9aa3c4d8f823d1cbbb86f6a892020aba, server=jenkins-hbase4.apache.org,41029,1689469866571}] 2023-07-16 01:12:29,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 01:12:30,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:12:30,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:12:30,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9aa3c4d8f823d1cbbb86f6a892020aba, disabling compactions & flushes 2023-07-16 01:12:30,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:12:30,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:12:30,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5294a8c7c3cb550d0a0b122eb741aac3, disabling compactions & flushes 2023-07-16 01:12:30,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. after waiting 0 ms 2023-07-16 01:12:30,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:12:30,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:12:30,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. after waiting 0 ms 2023-07-16 01:12:30,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:12:30,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:12:30,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:12:30,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:12:30,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:30,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:30,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba. 2023-07-16 01:12:30,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3. 2023-07-16 01:12:30,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9aa3c4d8f823d1cbbb86f6a892020aba: 2023-07-16 01:12:30,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5294a8c7c3cb550d0a0b122eb741aac3: 2023-07-16 01:12:30,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:12:30,135 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5294a8c7c3cb550d0a0b122eb741aac3, regionState=CLOSED 2023-07-16 01:12:30,135 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469950135"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469950135"}]},"ts":"1689469950135"} 2023-07-16 01:12:30,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:12:30,137 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=9aa3c4d8f823d1cbbb86f6a892020aba, regionState=CLOSED 2023-07-16 01:12:30,137 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689469950137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469950137"}]},"ts":"1689469950137"} 2023-07-16 01:12:30,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-16 01:12:30,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 5294a8c7c3cb550d0a0b122eb741aac3, server=jenkins-hbase4.apache.org,45775,1689469866515 in 171 msec 2023-07-16 01:12:30,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5294a8c7c3cb550d0a0b122eb741aac3, UNASSIGN in 212 msec 2023-07-16 01:12:30,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-16 01:12:30,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 9aa3c4d8f823d1cbbb86f6a892020aba, server=jenkins-hbase4.apache.org,41029,1689469866571 in 172 msec 2023-07-16 01:12:30,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-16 01:12:30,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9aa3c4d8f823d1cbbb86f6a892020aba, UNASSIGN in 220 msec 2023-07-16 01:12:30,149 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469950149"}]},"ts":"1689469950149"} 2023-07-16 01:12:30,150 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-16 01:12:30,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 01:12:30,209 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-16 01:12:30,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 368 msec 2023-07-16 01:12:30,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 01:12:30,482 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-16 01:12:30,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-16 01:12:30,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:30,487 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:30,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-16 01:12:30,488 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:30,491 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-16 01:12:30,494 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:12:30,494 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:12:30,496 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/recovered.edits] 2023-07-16 01:12:30,496 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/recovered.edits] 2023-07-16 01:12:30,501 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/cf/9b1bf418db9c4399b74fbaf5a208c860 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/cf/9b1bf418db9c4399b74fbaf5a208c860 2023-07-16 01:12:30,503 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/cf/93075b66af6f4b0382c242b207fd0ece to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/cf/93075b66af6f4b0382c242b207fd0ece 2023-07-16 01:12:30,506 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/recovered.edits/9.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3/recovered.edits/9.seqid 2023-07-16 01:12:30,506 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/5294a8c7c3cb550d0a0b122eb741aac3 2023-07-16 01:12:30,507 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/recovered.edits/9.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba/recovered.edits/9.seqid 2023-07-16 01:12:30,508 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testConsecutiveExports/9aa3c4d8f823d1cbbb86f6a892020aba 2023-07-16 01:12:30,508 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 01:12:30,510 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:30,513 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-16 01:12:30,515 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-16 01:12:30,516 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:30,516 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-16 01:12:30,516 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469950516"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:30,516 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469950516"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:30,518 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 01:12:30,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9aa3c4d8f823d1cbbb86f6a892020aba, NAME => 'testtb-testConsecutiveExports,,1689469914653.9aa3c4d8f823d1cbbb86f6a892020aba.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5294a8c7c3cb550d0a0b122eb741aac3, NAME => 'testtb-testConsecutiveExports,1,1689469914653.5294a8c7c3cb550d0a0b122eb741aac3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 01:12:30,518 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-16 01:12:30,518 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689469950518"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:30,520 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-16 01:12:30,588 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 01:12:30,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 105 msec 2023-07-16 01:12:30,601 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,601 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,602 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,602 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,602 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 01:12:30,602 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 01:12:30,602 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 01:12:30,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 01:12:30,665 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,665 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,665 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:30,665 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:30,665 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,665 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 01:12:30,665 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:30,665 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:30,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 01:12:30,667 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-16 01:12:30,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-16 01:12:30,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-16 01:12:30,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-16 01:12:30,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-16 01:12:30,742 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=750 (was 765), OpenFileDescriptor=898 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=438 (was 419) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=2478 (was 2837) 2023-07-16 01:12:30,742 WARN [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-16 01:12:30,763 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=750, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=438, ProcessCount=184, AvailableMemoryMB=2477 2023-07-16 01:12:30,763 WARN [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-16 01:12:30,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 01:12:30,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:30,768 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:12:30,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-16 01:12:30,769 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:12:30,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 01:12:30,771 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:30,771 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1 2023-07-16 01:12:30,772 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7 empty. 2023-07-16 01:12:30,772 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1 empty. 2023-07-16 01:12:30,773 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:30,773 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1 2023-07-16 01:12:30,773 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 01:12:30,789 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-16 01:12:30,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b7d74cbb67a392ace9b8fc55f6405e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:12:30,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3a663272c6658847703f43cd58053db1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:12:30,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 01:12:30,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:30,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 3a663272c6658847703f43cd58053db1, disabling compactions & flushes 2023-07-16 01:12:30,873 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:30,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:30,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. after waiting 0 ms 2023-07-16 01:12:30,874 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:30,874 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:30,874 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 3a663272c6658847703f43cd58053db1: 2023-07-16 01:12:30,877 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:30,877 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 0b7d74cbb67a392ace9b8fc55f6405e7, disabling compactions & flushes 2023-07-16 01:12:30,877 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:30,877 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:30,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. after waiting 0 ms 2023-07-16 01:12:30,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:30,878 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:30,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 0b7d74cbb67a392ace9b8fc55f6405e7: 2023-07-16 01:12:30,880 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:12:30,881 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469950881"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469950881"}]},"ts":"1689469950881"} 2023-07-16 01:12:30,881 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469950881"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469950881"}]},"ts":"1689469950881"} 2023-07-16 01:12:30,887 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:12:30,887 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:12:30,888 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469950887"}]},"ts":"1689469950887"} 2023-07-16 01:12:30,889 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-16 01:12:30,955 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:12:30,956 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:12:30,956 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:12:30,956 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:12:30,956 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:12:30,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b7d74cbb67a392ace9b8fc55f6405e7, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a663272c6658847703f43cd58053db1, ASSIGN}] 2023-07-16 01:12:30,959 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a663272c6658847703f43cd58053db1, ASSIGN 2023-07-16 01:12:30,959 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b7d74cbb67a392ace9b8fc55f6405e7, ASSIGN 2023-07-16 01:12:30,960 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a663272c6658847703f43cd58053db1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41029,1689469866571; forceNewPlan=false, retain=false 2023-07-16 01:12:30,960 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b7d74cbb67a392ace9b8fc55f6405e7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45775,1689469866515; forceNewPlan=false, retain=false 2023-07-16 01:12:31,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 01:12:31,110 INFO [jenkins-hbase4:39271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:12:31,113 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=3a663272c6658847703f43cd58053db1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,113 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0b7d74cbb67a392ace9b8fc55f6405e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,113 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469951113"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469951113"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469951113"}]},"ts":"1689469951113"} 2023-07-16 01:12:31,113 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469951113"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469951113"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469951113"}]},"ts":"1689469951113"} 2023-07-16 01:12:31,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 3a663272c6658847703f43cd58053db1, server=jenkins-hbase4.apache.org,41029,1689469866571}] 2023-07-16 01:12:31,116 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 0b7d74cbb67a392ace9b8fc55f6405e7, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:12:31,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:31,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b7d74cbb67a392ace9b8fc55f6405e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 01:12:31,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:31,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a663272c6658847703f43cd58053db1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 01:12:31,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. service=AccessControlService 2023-07-16 01:12:31,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. service=AccessControlService 2023-07-16 01:12:31,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:31,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:31,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:31,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:31,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:31,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 3a663272c6658847703f43cd58053db1 2023-07-16 01:12:31,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:31,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:31,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3a663272c6658847703f43cd58053db1 2023-07-16 01:12:31,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3a663272c6658847703f43cd58053db1 2023-07-16 01:12:31,275 INFO [StoreOpener-3a663272c6658847703f43cd58053db1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3a663272c6658847703f43cd58053db1 2023-07-16 01:12:31,279 INFO [StoreOpener-0b7d74cbb67a392ace9b8fc55f6405e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:31,280 DEBUG [StoreOpener-3a663272c6658847703f43cd58053db1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/cf 2023-07-16 01:12:31,280 DEBUG [StoreOpener-3a663272c6658847703f43cd58053db1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/cf 2023-07-16 01:12:31,280 DEBUG [StoreOpener-0b7d74cbb67a392ace9b8fc55f6405e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/cf 2023-07-16 01:12:31,280 DEBUG [StoreOpener-0b7d74cbb67a392ace9b8fc55f6405e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/cf 2023-07-16 01:12:31,281 INFO [StoreOpener-3a663272c6658847703f43cd58053db1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a663272c6658847703f43cd58053db1 columnFamilyName cf 2023-07-16 01:12:31,282 INFO [StoreOpener-0b7d74cbb67a392ace9b8fc55f6405e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b7d74cbb67a392ace9b8fc55f6405e7 columnFamilyName cf 2023-07-16 01:12:31,282 INFO [StoreOpener-3a663272c6658847703f43cd58053db1-1] regionserver.HStore(310): Store=3a663272c6658847703f43cd58053db1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:31,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1 2023-07-16 01:12:31,285 INFO [StoreOpener-0b7d74cbb67a392ace9b8fc55f6405e7-1] regionserver.HStore(310): Store=0b7d74cbb67a392ace9b8fc55f6405e7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:31,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1 2023-07-16 01:12:31,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:31,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:31,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3a663272c6658847703f43cd58053db1 2023-07-16 01:12:31,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:31,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:12:31,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:12:31,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3a663272c6658847703f43cd58053db1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65274743, jitterRate=-0.027330532670021057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:31,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3a663272c6658847703f43cd58053db1: 2023-07-16 01:12:31,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0b7d74cbb67a392ace9b8fc55f6405e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66828339, jitterRate=-0.004180148243904114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:31,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0b7d74cbb67a392ace9b8fc55f6405e7: 2023-07-16 01:12:31,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7., pid=61, masterSystemTime=1689469951268 2023-07-16 01:12:31,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1., pid=60, masterSystemTime=1689469951267 2023-07-16 01:12:31,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:31,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:31,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:31,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:31,316 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=3a663272c6658847703f43cd58053db1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,316 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0b7d74cbb67a392ace9b8fc55f6405e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,316 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469951315"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469951315"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469951315"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469951315"}]},"ts":"1689469951315"} 2023-07-16 01:12:31,316 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469951315"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469951315"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469951315"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469951315"}]},"ts":"1689469951315"} 2023-07-16 01:12:31,321 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-16 01:12:31,321 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 0b7d74cbb67a392ace9b8fc55f6405e7, server=jenkins-hbase4.apache.org,45775,1689469866515 in 203 msec 2023-07-16 01:12:31,322 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-16 01:12:31,322 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 3a663272c6658847703f43cd58053db1, server=jenkins-hbase4.apache.org,41029,1689469866571 in 204 msec 2023-07-16 01:12:31,322 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b7d74cbb67a392ace9b8fc55f6405e7, ASSIGN in 364 msec 2023-07-16 01:12:31,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-16 01:12:31,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a663272c6658847703f43cd58053db1, ASSIGN in 365 msec 2023-07-16 01:12:31,325 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:12:31,325 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469951325"}]},"ts":"1689469951325"} 2023-07-16 01:12:31,327 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-16 01:12:31,331 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:12:31,331 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-16 01:12:31,333 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 01:12:31,335 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:31,335 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:31,335 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:31,335 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:31,338 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:31,338 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:31,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:31,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:31,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 573 msec 2023-07-16 01:12:31,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 01:12:31,377 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-16 01:12:31,377 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-16 01:12:31,377 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:12:31,383 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-16 01:12:31,383 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:12:31,383 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-16 01:12:31,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 01:12:31,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469951395 (current time:1689469951395). 2023-07-16 01:12:31,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:12:31,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x114ea9a7 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:31,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f407a9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:31,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:31,421 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:31,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x114ea9a7 to 127.0.0.1:64468 2023-07-16 01:12:31,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:31,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x630edae1 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:31,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76944b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:31,447 DEBUG [hconnection-0xbf17262-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:31,448 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:31,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:31,458 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:31,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x630edae1 to 127.0.0.1:64468 2023-07-16 01:12:31,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:31,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 01:12:31,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:12:31,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 01:12:31,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 01:12:31,466 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 01:12:31,467 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689470551467 2023-07-16 01:12:31,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 01:12:31,470 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:12:31,470 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:12:31,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 01:12:31,479 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 01:12:31,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 16 msec 2023-07-16 01:12:31,482 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 01:12:31,483 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689470551483 2023-07-16 01:12:31,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,532 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 01:12:31,533 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,534 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 01:12:31,534 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 01:12:31,535 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,535 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,537 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,537 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,537 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,537 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 01:12:31,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 01:12:31,539 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 01:12:31,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,540 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 01:12:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,539 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,540 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 01:12:31,540 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,541 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:12:31,542 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 01:12:31,546 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,547 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 01:12:31,547 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,555 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 01:12:31,555 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,556 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 01:12:31,561 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 01:12:31,563 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 01:12:31,561 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 01:12:31,563 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 01:12:31,562 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,563 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 01:12:31,564 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 01:12:31,564 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 01:12:31,564 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 01:12:31,564 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 01:12:31,566 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,568 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,568 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,568 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,568 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,568 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:31,568 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,568 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:31,569 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,569 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:31,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,571 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 01:12:31,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67e8bc46[Count = 1] remaining members to acquire global barrier 2023-07-16 01:12:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 01:12:31,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:31,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,573 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:12:31,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 01:12:31,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67e8bc46[Count = 0] remaining members to acquire global barrier 2023-07-16 01:12:31,576 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 01:12:31,576 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,578 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,578 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,578 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 01:12:31,578 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,578 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 01:12:31,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,578 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 01:12:31,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,578 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,578 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:31,579 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:31,578 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 01:12:31,579 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. started... 2023-07-16 01:12:31,578 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:12:31,579 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:31,579 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:31,579 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:31,579 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:31,581 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. started... 2023-07-16 01:12:31,581 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,581 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:12:31,581 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b7d74cbb67a392ace9b8fc55f6405e7: 2023-07-16 01:12:31,583 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,583 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:31,583 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:12:31,583 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a663272c6658847703f43cd58053db1: 2023-07-16 01:12:31,584 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,584 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:31,584 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:12:31,588 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 01:12:31,588 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:31,588 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 01:12:31,628 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. completed. 2023-07-16 01:12:31,629 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:31,630 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:31,630 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:31,630 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,631 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 01:12:31,631 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:12:31,632 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. completed. 2023-07-16 01:12:31,632 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:31,632 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:31,633 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:31,633 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,633 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 01:12:31,633 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:12:31,634 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,634 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 01:12:31,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,634 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:31,634 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 01:12:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 01:12:31,636 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 01:12:31,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45775,1689469866515': 2023-07-16 01:12:31,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 01:12:31,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41029,1689469866571': 2023-07-16 01:12:31,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 01:12:31,647 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 01:12:31,647 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:12:31,647 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:12:31,648 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,648 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:12:31,649 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,650 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:31,650 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,650 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,650 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:31,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,650 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,650 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:31,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:31,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:31,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:31,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:31,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:31,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:31,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,652 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,652 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,653 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,655 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,655 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,655 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:31,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:31,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,659 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:31,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,659 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:31,659 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:31,661 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,661 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,662 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,662 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,662 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,662 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,662 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:31,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:31,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:31,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:31,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:31,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 01:12:31,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,727 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689469951468Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689469951659 (+191 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689469951662 (+3 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689469951674 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689469951695 (+21 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689469951727 (+32 ms) 2023-07-16 01:12:31,730 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 01:12:31,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 260 msec 2023-07-16 01:12:31,773 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:31,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 01:12:31,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:12:31,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45775] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:12:31,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41029] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:12:31,788 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,788 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:31,788 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:12:31,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 01:12:31,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469951799 (current time:1689469951799). 2023-07-16 01:12:31,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:12:31,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x4c120e63 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:31,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@356785ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:31,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:31,816 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:31,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c120e63 to 127.0.0.1:64468 2023-07-16 01:12:31,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:31,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x75e50e7e to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:31,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29d877b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:31,828 DEBUG [hconnection-0x2098ee93-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:31,831 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:31,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:31,837 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:31,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75e50e7e to 127.0.0.1:64468 2023-07-16 01:12:31,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:31,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 01:12:31,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:12:31,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 01:12:31,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 01:12:31,843 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 01:12:31,844 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689470551844 2023-07-16 01:12:31,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 01:12:31,844 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,846 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:12:31,846 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:12:31,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 01:12:31,847 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 01:12:31,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-16 01:12:31,850 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 01:12:31,851 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689470551851 2023-07-16 01:12:31,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,880 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 01:12:31,880 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,882 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 01:12:31,882 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 01:12:31,882 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,882 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,885 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,885 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,885 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,885 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:31,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:31,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:31,886 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,886 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,886 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,886 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:12:31,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 01:12:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,887 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 01:12:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 01:12:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 01:12:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,887 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 01:12:31,887 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 01:12:31,887 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,888 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 01:12:31,888 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,889 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 01:12:31,889 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 01:12:31,889 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 01:12:31,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,889 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 01:12:31,889 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,891 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 01:12:31,891 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 01:12:31,891 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 01:12:31,891 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 01:12:31,891 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:31,892 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 01:12:31,892 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 01:12:31,892 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 01:12:31,893 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,893 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,894 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,894 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,894 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,894 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:31,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,895 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,895 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,895 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:31,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,896 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,896 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:31,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 01:12:31,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55a9e0ac[Count = 1] remaining members to acquire global barrier 2023-07-16 01:12:31,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:31,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:31,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:31,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:31,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:31,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:31,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 01:12:31,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55a9e0ac[Count = 0] remaining members to acquire global barrier 2023-07-16 01:12:31,900 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 01:12:31,900 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,902 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,902 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,902 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,902 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:31,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,902 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 01:12:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,902 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 01:12:31,903 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 01:12:31,903 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:31,903 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:12:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,903 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:12:31,903 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 01:12:31,904 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 01:12:31,904 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:31,904 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 01:12:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:31,908 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:31,908 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:31,908 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:31,908 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. started... 2023-07-16 01:12:31,909 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. started... 2023-07-16 01:12:31,909 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0b7d74cbb67a392ace9b8fc55f6405e7 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 01:12:31,909 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3a663272c6658847703f43cd58053db1 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 01:12:31,946 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:31,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 01:12:31,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:31,948 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:12:31,954 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/.tmp/cf/865b77a4d2024628b7c44f46c2ad2542 2023-07-16 01:12:31,957 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/.tmp/cf/969f059154d244d3b0f1062a2fa03ab7 2023-07-16 01:12:31,961 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/.tmp/cf/865b77a4d2024628b7c44f46c2ad2542 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/cf/865b77a4d2024628b7c44f46c2ad2542 2023-07-16 01:12:31,965 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/.tmp/cf/969f059154d244d3b0f1062a2fa03ab7 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/cf/969f059154d244d3b0f1062a2fa03ab7 2023-07-16 01:12:31,968 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/cf/865b77a4d2024628b7c44f46c2ad2542, entries=47, sequenceid=6, filesize=8 K 2023-07-16 01:12:31,969 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 3a663272c6658847703f43cd58053db1 in 60ms, sequenceid=6, compaction requested=false 2023-07-16 01:12:31,969 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-16 01:12:31,970 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a663272c6658847703f43cd58053db1: 2023-07-16 01:12:31,970 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,970 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:31,970 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/cf/865b77a4d2024628b7c44f46c2ad2542] hfiles 2023-07-16 01:12:31,970 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/cf/865b77a4d2024628b7c44f46c2ad2542 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,970 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/cf/969f059154d244d3b0f1062a2fa03ab7, entries=3, sequenceid=6, filesize=5.0 K 2023-07-16 01:12:31,971 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 0b7d74cbb67a392ace9b8fc55f6405e7 in 62ms, sequenceid=6, compaction requested=false 2023-07-16 01:12:31,973 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b7d74cbb67a392ace9b8fc55f6405e7: 2023-07-16 01:12:31,973 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:31,973 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:31,973 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/cf/969f059154d244d3b0f1062a2fa03ab7] hfiles 2023-07-16 01:12:31,973 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/cf/969f059154d244d3b0f1062a2fa03ab7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,010 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. completed. 2023-07-16 01:12:32,010 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:32,010 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:32,011 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:32,011 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,011 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 01:12:32,011 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:12:32,013 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 01:12:32,013 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,013 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:32,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,013 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 01:12:32,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:32,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,030 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. completed. 2023-07-16 01:12:32,030 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:32,030 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:32,030 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:32,030 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:32,031 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 01:12:32,031 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:12:32,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,032 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41029,1689469866571': 2023-07-16 01:12:32,032 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 01:12:32,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 01:12:32,033 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:32,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:32,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:32,033 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 01:12:32,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:32,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:32,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:32,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:32,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:32,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:32,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:32,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45775,1689469866515': 2023-07-16 01:12:32,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 01:12:32,046 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 01:12:32,046 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:12:32,046 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:12:32,046 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,046 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:12:32,056 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,056 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:32,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:32,056 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:32,056 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,057 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:32,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,056 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,057 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:32,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,057 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:32,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:32,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:32,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:32,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:32,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:32,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:32,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:32,058 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:32,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,059 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:32,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:32,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:32,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:32,061 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:32,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,066 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:32,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:32,067 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:32,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,071 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:32,071 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:32,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:32,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:32,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:32,072 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,072 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,072 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:32,071 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:32,072 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:32,072 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:32,072 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:32,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:32,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:32,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:32,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:32,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:32,073 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:32,073 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,073 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,073 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,073 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:32,073 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:32,073 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,073 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:32,073 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:32,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:32,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:32,073 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:32,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,148 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:32,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 01:12:32,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:32,149 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:12:32,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,238 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 01:12:32,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,239 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:32,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689469951844Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689469952073 (+229 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689469952076 (+3 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689469952088 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689469952186 (+98 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689469952238 (+52 ms) 2023-07-16 01:12:32,242 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 01:12:32,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 397 msec 2023-07-16 01:12:32,450 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:32,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 01:12:32,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:12:32,483 DEBUG [Listener at jenkins-hbase4.apache.org/39957] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 01:12:32,488 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 01:12:32,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39681] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 01:12:32,490 DEBUG [Listener at jenkins-hbase4.apache.org/39957] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 01:12:32,495 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 01:12:32,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41029] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 01:12:32,496 DEBUG [Listener at jenkins-hbase4.apache.org/39957] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 01:12:32,499 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 01:12:32,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45775] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 01:12:32,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 01:12:32,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:32,505 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:12:32,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-16 01:12:32,506 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:12:32,509 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:32,509 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9 empty. 2023-07-16 01:12:32,510 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:32,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 01:12:32,516 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:32,517 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2 empty. 2023-07-16 01:12:32,517 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:32,518 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 01:12:32,555 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-16 01:12:32,556 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 83eebf155afd38311de0ff9a9b0412d9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:12:32,557 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1b51c6aad2998f02a8a6f324af70eae2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:12:32,583 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:32,583 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 83eebf155afd38311de0ff9a9b0412d9, disabling compactions & flushes 2023-07-16 01:12:32,583 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. 2023-07-16 01:12:32,583 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. 2023-07-16 01:12:32,583 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. after waiting 0 ms 2023-07-16 01:12:32,583 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. 2023-07-16 01:12:32,583 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. 2023-07-16 01:12:32,583 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 83eebf155afd38311de0ff9a9b0412d9: 2023-07-16 01:12:32,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:32,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 1b51c6aad2998f02a8a6f324af70eae2, disabling compactions & flushes 2023-07-16 01:12:32,594 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. 2023-07-16 01:12:32,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. 2023-07-16 01:12:32,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. after waiting 0 ms 2023-07-16 01:12:32,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. 2023-07-16 01:12:32,594 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. 2023-07-16 01:12:32,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 1b51c6aad2998f02a8a6f324af70eae2: 2023-07-16 01:12:32,597 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:12:32,598 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469952598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469952598"}]},"ts":"1689469952598"} 2023-07-16 01:12:32,598 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469952598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469952598"}]},"ts":"1689469952598"} 2023-07-16 01:12:32,600 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:12:32,604 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:12:32,604 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469952604"}]},"ts":"1689469952604"} 2023-07-16 01:12:32,606 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-16 01:12:32,609 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:12:32,611 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:12:32,611 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:12:32,611 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:12:32,611 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:12:32,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83eebf155afd38311de0ff9a9b0412d9, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b51c6aad2998f02a8a6f324af70eae2, ASSIGN}] 2023-07-16 01:12:32,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 01:12:32,615 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b51c6aad2998f02a8a6f324af70eae2, ASSIGN 2023-07-16 01:12:32,615 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83eebf155afd38311de0ff9a9b0412d9, ASSIGN 2023-07-16 01:12:32,616 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b51c6aad2998f02a8a6f324af70eae2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41029,1689469866571; forceNewPlan=false, retain=false 2023-07-16 01:12:32,616 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83eebf155afd38311de0ff9a9b0412d9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39681,1689469866446; forceNewPlan=false, retain=false 2023-07-16 01:12:32,767 INFO [jenkins-hbase4:39271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:12:32,770 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=83eebf155afd38311de0ff9a9b0412d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:32,770 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=1b51c6aad2998f02a8a6f324af70eae2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,771 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469952770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469952770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469952770"}]},"ts":"1689469952770"} 2023-07-16 01:12:32,771 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469952770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469952770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469952770"}]},"ts":"1689469952770"} 2023-07-16 01:12:32,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 83eebf155afd38311de0ff9a9b0412d9, server=jenkins-hbase4.apache.org,39681,1689469866446}] 2023-07-16 01:12:32,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 1b51c6aad2998f02a8a6f324af70eae2, server=jenkins-hbase4.apache.org,41029,1689469866571}] 2023-07-16 01:12:32,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 01:12:32,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. 2023-07-16 01:12:32,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. 2023-07-16 01:12:32,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b51c6aad2998f02a8a6f324af70eae2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2.', STARTKEY => '2', ENDKEY => ''} 2023-07-16 01:12:32,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83eebf155afd38311de0ff9a9b0412d9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9.', STARTKEY => '', ENDKEY => '2'} 2023-07-16 01:12:32,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. service=AccessControlService 2023-07-16 01:12:32,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. service=AccessControlService 2023-07-16 01:12:32,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:32,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:32,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:32,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:32,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:32,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:32,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:32,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:32,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:32,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:32,936 INFO [StoreOpener-83eebf155afd38311de0ff9a9b0412d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:32,936 INFO [StoreOpener-1b51c6aad2998f02a8a6f324af70eae2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:32,938 DEBUG [StoreOpener-83eebf155afd38311de0ff9a9b0412d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/cf 2023-07-16 01:12:32,938 DEBUG [StoreOpener-83eebf155afd38311de0ff9a9b0412d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/cf 2023-07-16 01:12:32,938 DEBUG [StoreOpener-1b51c6aad2998f02a8a6f324af70eae2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/cf 2023-07-16 01:12:32,938 DEBUG [StoreOpener-1b51c6aad2998f02a8a6f324af70eae2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/cf 2023-07-16 01:12:32,939 INFO [StoreOpener-83eebf155afd38311de0ff9a9b0412d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83eebf155afd38311de0ff9a9b0412d9 columnFamilyName cf 2023-07-16 01:12:32,939 INFO [StoreOpener-1b51c6aad2998f02a8a6f324af70eae2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b51c6aad2998f02a8a6f324af70eae2 columnFamilyName cf 2023-07-16 01:12:32,939 INFO [StoreOpener-83eebf155afd38311de0ff9a9b0412d9-1] regionserver.HStore(310): Store=83eebf155afd38311de0ff9a9b0412d9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:32,940 INFO [StoreOpener-1b51c6aad2998f02a8a6f324af70eae2-1] regionserver.HStore(310): Store=1b51c6aad2998f02a8a6f324af70eae2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:32,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:32,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:32,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:32,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:32,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:32,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:32,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:12:32,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 83eebf155afd38311de0ff9a9b0412d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69053643, jitterRate=0.02897946536540985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:32,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 83eebf155afd38311de0ff9a9b0412d9: 2023-07-16 01:12:32,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:12:32,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9., pid=69, masterSystemTime=1689469952926 2023-07-16 01:12:32,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. 2023-07-16 01:12:32,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. 2023-07-16 01:12:32,957 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=83eebf155afd38311de0ff9a9b0412d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:32,957 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469952957"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469952957"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469952957"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469952957"}]},"ts":"1689469952957"} 2023-07-16 01:12:32,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b51c6aad2998f02a8a6f324af70eae2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72567049, jitterRate=0.08133329451084137}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:32,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b51c6aad2998f02a8a6f324af70eae2: 2023-07-16 01:12:32,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2., pid=70, masterSystemTime=1689469952927 2023-07-16 01:12:32,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. 2023-07-16 01:12:32,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. 2023-07-16 01:12:32,966 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=1b51c6aad2998f02a8a6f324af70eae2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:32,967 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469952966"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469952966"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469952966"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469952966"}]},"ts":"1689469952966"} 2023-07-16 01:12:32,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-16 01:12:32,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 83eebf155afd38311de0ff9a9b0412d9, server=jenkins-hbase4.apache.org,39681,1689469866446 in 187 msec 2023-07-16 01:12:32,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83eebf155afd38311de0ff9a9b0412d9, ASSIGN in 358 msec 2023-07-16 01:12:32,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-16 01:12:32,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 1b51c6aad2998f02a8a6f324af70eae2, server=jenkins-hbase4.apache.org,41029,1689469866571 in 194 msec 2023-07-16 01:12:32,981 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-16 01:12:32,981 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b51c6aad2998f02a8a6f324af70eae2, ASSIGN in 366 msec 2023-07-16 01:12:32,982 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:12:32,982 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469952982"}]},"ts":"1689469952982"} 2023-07-16 01:12:32,984 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-16 01:12:32,989 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:12:32,989 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-16 01:12:32,992 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 01:12:32,994 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:32,994 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:32,994 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:32,994 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:32,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:32,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:32,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:32,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:32,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:32,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:32,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:32,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:32,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 495 msec 2023-07-16 01:12:33,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 01:12:33,118 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-16 01:12:33,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 83eebf155afd38311de0ff9a9b0412d9, 1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:33,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[83eebf155afd38311de0ff9a9b0412d9, 1b51c6aad2998f02a8a6f324af70eae2], force=true 2023-07-16 01:12:33,169 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[83eebf155afd38311de0ff9a9b0412d9, 1b51c6aad2998f02a8a6f324af70eae2], force=true 2023-07-16 01:12:33,169 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[83eebf155afd38311de0ff9a9b0412d9, 1b51c6aad2998f02a8a6f324af70eae2], force=true 2023-07-16 01:12:33,169 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[83eebf155afd38311de0ff9a9b0412d9, 1b51c6aad2998f02a8a6f324af70eae2], force=true 2023-07-16 01:12:33,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 01:12:33,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83eebf155afd38311de0ff9a9b0412d9, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b51c6aad2998f02a8a6f324af70eae2, UNASSIGN}] 2023-07-16 01:12:33,212 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83eebf155afd38311de0ff9a9b0412d9, UNASSIGN 2023-07-16 01:12:33,212 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b51c6aad2998f02a8a6f324af70eae2, UNASSIGN 2023-07-16 01:12:33,213 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=83eebf155afd38311de0ff9a9b0412d9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:33,213 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=1b51c6aad2998f02a8a6f324af70eae2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:33,213 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469953213"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469953213"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469953213"}]},"ts":"1689469953213"} 2023-07-16 01:12:33,213 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469953213"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469953213"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469953213"}]},"ts":"1689469953213"} 2023-07-16 01:12:33,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 83eebf155afd38311de0ff9a9b0412d9, server=jenkins-hbase4.apache.org,39681,1689469866446}] 2023-07-16 01:12:33,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 1b51c6aad2998f02a8a6f324af70eae2, server=jenkins-hbase4.apache.org,41029,1689469866571}] 2023-07-16 01:12:33,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 01:12:33,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:33,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:33,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b51c6aad2998f02a8a6f324af70eae2, disabling compactions & flushes 2023-07-16 01:12:33,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. 2023-07-16 01:12:33,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. 2023-07-16 01:12:33,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 83eebf155afd38311de0ff9a9b0412d9, disabling compactions & flushes 2023-07-16 01:12:33,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. after waiting 0 ms 2023-07-16 01:12:33,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. 2023-07-16 01:12:33,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. 2023-07-16 01:12:33,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1b51c6aad2998f02a8a6f324af70eae2 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 01:12:33,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. 2023-07-16 01:12:33,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. after waiting 0 ms 2023-07-16 01:12:33,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. 2023-07-16 01:12:33,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 83eebf155afd38311de0ff9a9b0412d9 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 01:12:33,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/.tmp/cf/f9dfa181773c4ac09cf286eda0ffd9b5 2023-07-16 01:12:33,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/.tmp/cf/f9dfa181773c4ac09cf286eda0ffd9b5 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/cf/f9dfa181773c4ac09cf286eda0ffd9b5 2023-07-16 01:12:33,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/.tmp/cf/262086003ef44efbaac6c67eff76d334 2023-07-16 01:12:33,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/cf/f9dfa181773c4ac09cf286eda0ffd9b5, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 01:12:33,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 83eebf155afd38311de0ff9a9b0412d9 in 34ms, sequenceid=5, compaction requested=false 2023-07-16 01:12:33,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 01:12:33,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/.tmp/cf/262086003ef44efbaac6c67eff76d334 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/cf/262086003ef44efbaac6c67eff76d334 2023-07-16 01:12:33,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 01:12:33,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:33,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9. 2023-07-16 01:12:33,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 83eebf155afd38311de0ff9a9b0412d9: 2023-07-16 01:12:33,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:33,423 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=83eebf155afd38311de0ff9a9b0412d9, regionState=CLOSED 2023-07-16 01:12:33,423 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469953422"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469953422"}]},"ts":"1689469953422"} 2023-07-16 01:12:33,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/cf/262086003ef44efbaac6c67eff76d334, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 01:12:33,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 1b51c6aad2998f02a8a6f324af70eae2 in 57ms, sequenceid=5, compaction requested=false 2023-07-16 01:12:33,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-16 01:12:33,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 83eebf155afd38311de0ff9a9b0412d9, server=jenkins-hbase4.apache.org,39681,1689469866446 in 213 msec 2023-07-16 01:12:33,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=83eebf155afd38311de0ff9a9b0412d9, UNASSIGN in 241 msec 2023-07-16 01:12:33,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 01:12:33,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:33,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2. 2023-07-16 01:12:33,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b51c6aad2998f02a8a6f324af70eae2: 2023-07-16 01:12:33,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:33,457 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=1b51c6aad2998f02a8a6f324af70eae2, regionState=CLOSED 2023-07-16 01:12:33,457 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689469953457"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469953457"}]},"ts":"1689469953457"} 2023-07-16 01:12:33,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-16 01:12:33,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 1b51c6aad2998f02a8a6f324af70eae2, server=jenkins-hbase4.apache.org,41029,1689469866571 in 242 msec 2023-07-16 01:12:33,468 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-16 01:12:33,468 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1b51c6aad2998f02a8a6f324af70eae2, UNASSIGN in 262 msec 2023-07-16 01:12:33,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 01:12:33,560 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-16 01:12:33,567 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952501.83eebf155afd38311de0ff9a9b0412d9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:33,567 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689469952501.1b51c6aad2998f02a8a6f324af70eae2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:33,567 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:33,635 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b02c7ac7366d22c9c66bedaee43eac1a, ASSIGN}] 2023-07-16 01:12:33,636 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b02c7ac7366d22c9c66bedaee43eac1a, ASSIGN 2023-07-16 01:12:33,637 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b02c7ac7366d22c9c66bedaee43eac1a, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39681,1689469866446; forceNewPlan=false, retain=false 2023-07-16 01:12:33,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 01:12:33,787 INFO [jenkins-hbase4:39271] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 01:12:33,789 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b02c7ac7366d22c9c66bedaee43eac1a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:33,790 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689469953789"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469953789"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469953789"}]},"ts":"1689469953789"} 2023-07-16 01:12:33,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure b02c7ac7366d22c9c66bedaee43eac1a, server=jenkins-hbase4.apache.org,39681,1689469866446}] 2023-07-16 01:12:33,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. 2023-07-16 01:12:33,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b02c7ac7366d22c9c66bedaee43eac1a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a.', STARTKEY => '', ENDKEY => ''} 2023-07-16 01:12:33,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. service=AccessControlService 2023-07-16 01:12:33,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:33,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b02c7ac7366d22c9c66bedaee43eac1a 2023-07-16 01:12:33,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:33,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b02c7ac7366d22c9c66bedaee43eac1a 2023-07-16 01:12:33,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b02c7ac7366d22c9c66bedaee43eac1a 2023-07-16 01:12:33,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/.regioninfo 2023-07-16 01:12:33,963 INFO [StoreOpener-b02c7ac7366d22c9c66bedaee43eac1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b02c7ac7366d22c9c66bedaee43eac1a 2023-07-16 01:12:33,964 DEBUG [StoreOpener-b02c7ac7366d22c9c66bedaee43eac1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf 2023-07-16 01:12:33,964 DEBUG [StoreOpener-b02c7ac7366d22c9c66bedaee43eac1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf 2023-07-16 01:12:33,965 INFO [StoreOpener-b02c7ac7366d22c9c66bedaee43eac1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b02c7ac7366d22c9c66bedaee43eac1a columnFamilyName cf 2023-07-16 01:12:34,003 DEBUG [StoreOpener-b02c7ac7366d22c9c66bedaee43eac1a-1] regionserver.HStore(539): loaded hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf/262086003ef44efbaac6c67eff76d334.1b51c6aad2998f02a8a6f324af70eae2->hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/cf/262086003ef44efbaac6c67eff76d334-top 2023-07-16 01:12:34,008 DEBUG [StoreOpener-b02c7ac7366d22c9c66bedaee43eac1a-1] regionserver.HStore(539): loaded hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf/f9dfa181773c4ac09cf286eda0ffd9b5.83eebf155afd38311de0ff9a9b0412d9->hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/cf/f9dfa181773c4ac09cf286eda0ffd9b5-top 2023-07-16 01:12:34,009 INFO [StoreOpener-b02c7ac7366d22c9c66bedaee43eac1a-1] regionserver.HStore(310): Store=b02c7ac7366d22c9c66bedaee43eac1a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:34,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a 2023-07-16 01:12:34,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a 2023-07-16 01:12:34,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b02c7ac7366d22c9c66bedaee43eac1a 2023-07-16 01:12:34,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b02c7ac7366d22c9c66bedaee43eac1a; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64872643, jitterRate=-0.0333222895860672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:34,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b02c7ac7366d22c9c66bedaee43eac1a: 2023-07-16 01:12:34,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a., pid=77, masterSystemTime=1689469953944 2023-07-16 01:12:34,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a.,because compaction is disabled. 2023-07-16 01:12:34,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. 2023-07-16 01:12:34,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. 2023-07-16 01:12:34,019 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b02c7ac7366d22c9c66bedaee43eac1a, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,019 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689469954019"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469954019"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469954019"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469954019"}]},"ts":"1689469954019"} 2023-07-16 01:12:34,026 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-16 01:12:34,026 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure b02c7ac7366d22c9c66bedaee43eac1a, server=jenkins-hbase4.apache.org,39681,1689469866446 in 232 msec 2023-07-16 01:12:34,028 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-16 01:12:34,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b02c7ac7366d22c9c66bedaee43eac1a, ASSIGN in 391 msec 2023-07-16 01:12:34,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[83eebf155afd38311de0ff9a9b0412d9, 1b51c6aad2998f02a8a6f324af70eae2], force=true in 871 msec 2023-07-16 01:12:34,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 01:12:34,278 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-16 01:12:34,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 01:12:34,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469954279 (current time:1689469954279). 2023-07-16 01:12:34,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:12:34,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x53455c86 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:34,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27ea61c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:34,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:34,295 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:34,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53455c86 to 127.0.0.1:64468 2023-07-16 01:12:34,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:34,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x69038379 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:34,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10db53b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:34,306 DEBUG [hconnection-0x64cb8441-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:34,309 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:34,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:34,318 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:34,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69038379 to 127.0.0.1:64468 2023-07-16 01:12:34,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:34,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 01:12:34,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:12:34,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 01:12:34,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 01:12:34,324 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 01:12:34,325 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689470554325 2023-07-16 01:12:34,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 01:12:34,329 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:12:34,329 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:12:34,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 01:12:34,336 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 01:12:34,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 14 msec 2023-07-16 01:12:34,340 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 01:12:34,341 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689470554341 2023-07-16 01:12:34,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,361 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 01:12:34,361 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:34,363 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-16 01:12:34,363 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-16 01:12:34,364 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,364 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,365 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:34,365 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:34,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:34,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:34,366 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:34,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:34,365 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:34,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:34,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:34,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,366 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,366 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:12:34,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 01:12:34,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,367 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 01:12:34,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 01:12:34,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,368 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 01:12:34,368 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 01:12:34,368 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:34,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 01:12:34,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,375 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 01:12:34,381 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 01:12:34,381 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 01:12:34,381 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 01:12:34,381 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:34,381 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 01:12:34,384 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 01:12:34,384 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,384 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 01:12:34,384 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 01:12:34,384 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 01:12:34,384 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:34,386 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 01:12:34,386 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 01:12:34,386 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 01:12:34,388 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,395 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,395 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:34,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:34,396 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:34,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:34,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:34,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-16 01:12:34,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d3fdba3[Count = 0] remaining members to acquire global barrier 2023-07-16 01:12:34,399 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-16 01:12:34,399 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,402 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,402 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,403 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,403 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:12:34,403 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,403 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 01:12:34,403 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 01:12:34,403 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:12:34,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,403 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 01:12:34,403 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 01:12:34,403 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:12:34,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,404 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 01:12:34,404 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:34,404 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:34,404 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. 2023-07-16 01:12:34,404 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. started... 2023-07-16 01:12:34,405 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 01:12:34,405 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:34,405 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 01:12:34,407 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b02c7ac7366d22c9c66bedaee43eac1a: 2023-07-16 01:12:34,407 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,407 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:34,407 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf/262086003ef44efbaac6c67eff76d334.1b51c6aad2998f02a8a6f324af70eae2->hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/cf/262086003ef44efbaac6c67eff76d334-top, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf/f9dfa181773c4ac09cf286eda0ffd9b5.83eebf155afd38311de0ff9a9b0412d9->hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/cf/f9dfa181773c4ac09cf286eda0ffd9b5-top] hfiles 2023-07-16 01:12:34,408 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf/262086003ef44efbaac6c67eff76d334.1b51c6aad2998f02a8a6f324af70eae2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,408 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf/f9dfa181773c4ac09cf286eda0ffd9b5.83eebf155afd38311de0ff9a9b0412d9 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,409 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 01:12:34,409 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:34,409 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 01:12:34,429 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:34,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 01:12:34,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:34,431 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:12:34,434 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. completed. 2023-07-16 01:12:34,434 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. 2023-07-16 01:12:34,434 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:34,434 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:34,434 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,435 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 01:12:34,435 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:12:34,440 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:34,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:34,440 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 01:12:34,440 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:34,440 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 01:12:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:34,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:34,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:34,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:34,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:34,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39681,1689469866446': 2023-07-16 01:12:34,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-16 01:12:34,449 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-16 01:12:34,449 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:12:34,449 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:12:34,449 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,449 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:12:34,451 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,451 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:34,451 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,451 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,451 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:34,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,451 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,452 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:34,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:34,452 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:34,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:34,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:34,454 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,455 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:34,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:34,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:34,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:34,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,457 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:34,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:34,458 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,458 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:34,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:34,462 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:34,463 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:34,463 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,463 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,463 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:34,463 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:34,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:34,463 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:34,463 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:34,463 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:34,463 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:34,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:34,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:34,463 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:34,463 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:34,464 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,463 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:34,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:34,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:34,463 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:34,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:34,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:34,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:34,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,464 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:34,465 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:34,465 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,465 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:34,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:34,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,631 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:34,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 01:12:34,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:34,633 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:12:34,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-16 01:12:34,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,710 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689469954325Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689469954464 (+139 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689469954465 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689469954469 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689469954527 (+58 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689469954709 (+182 ms) 2023-07-16 01:12:34,713 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 01:12:34,715 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 386 msec 2023-07-16 01:12:34,804 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0004_000001 (auth:SIMPLE) 2023-07-16 01:12:34,933 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:34,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 01:12:34,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:12:34,935 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469954935 2023-07-16 01:12:34,935 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40869, tgtDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469954935, rawTgtDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469954935, srcFsUri=hdfs://localhost:40869, srcDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:12:34,966 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:12:34,966 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-210878219_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469954935, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469954935/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:34,966 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5, snapshotDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-16 01:12:34,977 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469954935/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:35,021 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:35,021 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:35,022 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:35,022 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:35,748 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:12:36,272 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-5369918560805442610.jar 2023-07-16 01:12:36,272 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,273 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,362 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-162677203760006980.jar 2023-07-16 01:12:36,363 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,363 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,364 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,364 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,365 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,365 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:36,366 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:12:36,367 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:12:36,367 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:12:36,368 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:12:36,368 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:12:36,369 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:12:36,370 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:12:36,370 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:12:36,371 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:12:36,371 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:12:36,372 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:36,373 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:36,374 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:36,374 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:36,375 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:36,375 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:36,376 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:37,246 WARN [Listener at jenkins-hbase4.apache.org/39957] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:12:37,249 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-16 01:12:37,252 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-16 01:12:37,372 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:12:37,372 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:12:37,551 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0005_000001 (auth:SIMPLE) 2023-07-16 01:12:43,482 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0005_000001 (auth:SIMPLE) 2023-07-16 01:12:45,871 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0005_000001 (auth:SIMPLE) 2023-07-16 01:12:49,540 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0005_000001 (auth:SIMPLE) 2023-07-16 01:12:50,617 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:12:50,620 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:12:50,635 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,635 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:12:50,636 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:12:50,636 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1398488159_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,637 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 01:12:50,637 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 01:12:50,637 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1398488159_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469954935/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469954935/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,638 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469954935/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 01:12:50,638 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469954935/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 01:12:50,646 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,652 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469970652"}]},"ts":"1689469970652"} 2023-07-16 01:12:50,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 01:12:50,654 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-16 01:12:50,656 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-16 01:12:50,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b02c7ac7366d22c9c66bedaee43eac1a, UNASSIGN}] 2023-07-16 01:12:50,659 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b02c7ac7366d22c9c66bedaee43eac1a, UNASSIGN 2023-07-16 01:12:50,660 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b02c7ac7366d22c9c66bedaee43eac1a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:50,660 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689469970660"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469970660"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469970660"}]},"ts":"1689469970660"} 2023-07-16 01:12:50,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure b02c7ac7366d22c9c66bedaee43eac1a, server=jenkins-hbase4.apache.org,39681,1689469866446}] 2023-07-16 01:12:50,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 01:12:50,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b02c7ac7366d22c9c66bedaee43eac1a 2023-07-16 01:12:50,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b02c7ac7366d22c9c66bedaee43eac1a, disabling compactions & flushes 2023-07-16 01:12:50,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. 2023-07-16 01:12:50,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. 2023-07-16 01:12:50,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. after waiting 0 ms 2023-07-16 01:12:50,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. 2023-07-16 01:12:50,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-16 01:12:50,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:50,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a. 2023-07-16 01:12:50,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b02c7ac7366d22c9c66bedaee43eac1a: 2023-07-16 01:12:50,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b02c7ac7366d22c9c66bedaee43eac1a 2023-07-16 01:12:50,872 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b02c7ac7366d22c9c66bedaee43eac1a, regionState=CLOSED 2023-07-16 01:12:50,872 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689469970872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469970872"}]},"ts":"1689469970872"} 2023-07-16 01:12:50,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-16 01:12:50,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure b02c7ac7366d22c9c66bedaee43eac1a, server=jenkins-hbase4.apache.org,39681,1689469866446 in 211 msec 2023-07-16 01:12:50,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-16 01:12:50,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b02c7ac7366d22c9c66bedaee43eac1a, UNASSIGN in 219 msec 2023-07-16 01:12:50,877 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469970877"}]},"ts":"1689469970877"} 2023-07-16 01:12:50,879 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-16 01:12:50,880 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-16 01:12:50,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 234 msec 2023-07-16 01:12:50,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 01:12:50,957 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-16 01:12:50,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,963 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,964 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,966 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,969 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:50,969 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:50,969 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a 2023-07-16 01:12:50,970 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,970 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 01:12:50,971 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 01:12:50,971 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,972 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,972 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:50,972 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:50,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-16 01:12:50,972 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 01:12:50,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-16 01:12:50,972 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 01:12:50,972 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:50,972 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:50,973 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:50,973 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:50,973 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/recovered.edits] 2023-07-16 01:12:50,973 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:50,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 01:12:50,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:50,974 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/recovered.edits] 2023-07-16 01:12:50,975 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/recovered.edits] 2023-07-16 01:12:50,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:50,981 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/cf/262086003ef44efbaac6c67eff76d334 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/cf/262086003ef44efbaac6c67eff76d334 2023-07-16 01:12:50,982 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/cf/f9dfa181773c4ac09cf286eda0ffd9b5 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/cf/f9dfa181773c4ac09cf286eda0ffd9b5 2023-07-16 01:12:50,983 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf/262086003ef44efbaac6c67eff76d334.1b51c6aad2998f02a8a6f324af70eae2 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf/262086003ef44efbaac6c67eff76d334.1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:50,986 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf/f9dfa181773c4ac09cf286eda0ffd9b5.83eebf155afd38311de0ff9a9b0412d9 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/cf/f9dfa181773c4ac09cf286eda0ffd9b5.83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:50,987 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/recovered.edits/8.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2/recovered.edits/8.seqid 2023-07-16 01:12:50,988 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1b51c6aad2998f02a8a6f324af70eae2 2023-07-16 01:12:50,988 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/recovered.edits/8.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9/recovered.edits/8.seqid 2023-07-16 01:12:50,988 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/83eebf155afd38311de0ff9a9b0412d9 2023-07-16 01:12:50,990 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/recovered.edits/12.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a/recovered.edits/12.seqid 2023-07-16 01:12:50,990 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b02c7ac7366d22c9c66bedaee43eac1a 2023-07-16 01:12:50,990 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 01:12:50,999 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:51,002 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-16 01:12:51,005 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-16 01:12:51,006 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:51,006 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-16 01:12:51,007 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469971006"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:51,016 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-16 01:12:51,016 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b02c7ac7366d22c9c66bedaee43eac1a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689469952502.b02c7ac7366d22c9c66bedaee43eac1a.', STARTKEY => '', ENDKEY => ''}] 2023-07-16 01:12:51,016 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-16 01:12:51,016 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689469971016"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:51,027 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-16 01:12:51,030 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:51,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 72 msec 2023-07-16 01:12:51,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 01:12:51,076 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-16 01:12:51,076 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 01:12:51,083 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469971083"}]},"ts":"1689469971083"} 2023-07-16 01:12:51,084 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-16 01:12:51,087 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-16 01:12:51,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b7d74cbb67a392ace9b8fc55f6405e7, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a663272c6658847703f43cd58053db1, UNASSIGN}] 2023-07-16 01:12:51,090 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b7d74cbb67a392ace9b8fc55f6405e7, UNASSIGN 2023-07-16 01:12:51,090 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a663272c6658847703f43cd58053db1, UNASSIGN 2023-07-16 01:12:51,091 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0b7d74cbb67a392ace9b8fc55f6405e7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:51,091 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=3a663272c6658847703f43cd58053db1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:51,091 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469971091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469971091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469971091"}]},"ts":"1689469971091"} 2023-07-16 01:12:51,091 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469971091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469971091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469971091"}]},"ts":"1689469971091"} 2023-07-16 01:12:51,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 3a663272c6658847703f43cd58053db1, server=jenkins-hbase4.apache.org,41029,1689469866571}] 2023-07-16 01:12:51,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 0b7d74cbb67a392ace9b8fc55f6405e7, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:12:51,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 01:12:51,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3a663272c6658847703f43cd58053db1 2023-07-16 01:12:51,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3a663272c6658847703f43cd58053db1, disabling compactions & flushes 2023-07-16 01:12:51,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:51,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:51,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. after waiting 0 ms 2023-07-16 01:12:51,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:51,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:51,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0b7d74cbb67a392ace9b8fc55f6405e7, disabling compactions & flushes 2023-07-16 01:12:51,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:51,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:51,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. after waiting 0 ms 2023-07-16 01:12:51,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:51,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:12:51,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:51,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1. 2023-07-16 01:12:51,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3a663272c6658847703f43cd58053db1: 2023-07-16 01:12:51,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3a663272c6658847703f43cd58053db1 2023-07-16 01:12:51,331 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=3a663272c6658847703f43cd58053db1, regionState=CLOSED 2023-07-16 01:12:51,331 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469971331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469971331"}]},"ts":"1689469971331"} 2023-07-16 01:12:51,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:12:51,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:12:51,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7. 2023-07-16 01:12:51,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0b7d74cbb67a392ace9b8fc55f6405e7: 2023-07-16 01:12:51,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-16 01:12:51,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 3a663272c6658847703f43cd58053db1, server=jenkins-hbase4.apache.org,41029,1689469866571 in 246 msec 2023-07-16 01:12:51,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:51,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a663272c6658847703f43cd58053db1, UNASSIGN in 258 msec 2023-07-16 01:12:51,355 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0b7d74cbb67a392ace9b8fc55f6405e7, regionState=CLOSED 2023-07-16 01:12:51,356 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689469971355"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469971355"}]},"ts":"1689469971355"} 2023-07-16 01:12:51,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-16 01:12:51,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 0b7d74cbb67a392ace9b8fc55f6405e7, server=jenkins-hbase4.apache.org,45775,1689469866515 in 251 msec 2023-07-16 01:12:51,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-16 01:12:51,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0b7d74cbb67a392ace9b8fc55f6405e7, UNASSIGN in 275 msec 2023-07-16 01:12:51,376 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469971376"}]},"ts":"1689469971376"} 2023-07-16 01:12:51,378 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-16 01:12:51,380 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-16 01:12:51,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 304 msec 2023-07-16 01:12:51,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 01:12:51,385 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-16 01:12:51,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,389 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,391 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,392 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,397 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,397 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,397 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,397 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 01:12:51,397 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:51,397 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1 2023-07-16 01:12:51,397 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 01:12:51,397 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 01:12:51,398 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,400 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/recovered.edits] 2023-07-16 01:12:51,400 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/recovered.edits] 2023-07-16 01:12:51,400 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,400 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:51,400 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,400 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:51,400 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-16 01:12:51,400 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 01:12:51,400 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:51,400 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,401 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:51,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 01:12:51,413 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/cf/865b77a4d2024628b7c44f46c2ad2542 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/cf/865b77a4d2024628b7c44f46c2ad2542 2023-07-16 01:12:51,415 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/cf/969f059154d244d3b0f1062a2fa03ab7 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/cf/969f059154d244d3b0f1062a2fa03ab7 2023-07-16 01:12:51,417 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/recovered.edits/9.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1/recovered.edits/9.seqid 2023-07-16 01:12:51,418 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a663272c6658847703f43cd58053db1 2023-07-16 01:12:51,420 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/recovered.edits/9.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7/recovered.edits/9.seqid 2023-07-16 01:12:51,421 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0b7d74cbb67a392ace9b8fc55f6405e7 2023-07-16 01:12:51,421 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 01:12:51,424 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,426 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-16 01:12:51,429 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-16 01:12:51,431 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,431 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-16 01:12:51,431 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469971431"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:51,431 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469971431"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:51,434 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 01:12:51,434 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0b7d74cbb67a392ace9b8fc55f6405e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689469950764.0b7d74cbb67a392ace9b8fc55f6405e7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3a663272c6658847703f43cd58053db1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689469950764.3a663272c6658847703f43cd58053db1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 01:12:51,434 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-16 01:12:51,434 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689469971434"}]},"ts":"9223372036854775807"} 2023-07-16 01:12:51,436 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-16 01:12:51,438 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 52 msec 2023-07-16 01:12:51,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 01:12:51,503 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-16 01:12:51,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 01:12:51,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 01:12:51,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 01:12:51,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-16 01:12:51,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 01:12:51,547 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=764 (was 750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-303396503_1 at /127.0.0.1:43612 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:48126 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4179 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:41828 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-303396503_1 at /127.0.0.1:40102 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:48128 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:46517 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:38544 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=909 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=560 (was 438) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=2280 (was 2477) 2023-07-16 01:12:51,547 WARN [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-16 01:12:51,569 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=764, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=560, ProcessCount=184, AvailableMemoryMB=2280 2023-07-16 01:12:51,569 WARN [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-16 01:12:51,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 01:12:51,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:12:51,604 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:12:51,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-16 01:12:51,605 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:12:51,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 01:12:51,607 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51 2023-07-16 01:12:51,607 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011 2023-07-16 01:12:51,608 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51 empty. 2023-07-16 01:12:51,608 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011 empty. 2023-07-16 01:12:51,608 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51 2023-07-16 01:12:51,608 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011 2023-07-16 01:12:51,608 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 01:12:51,629 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 01:12:51,633 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f804f874f297fddf7bef66de6f634011, NAME => 'testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:12:51,633 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 78191c5e86349b2706b846dbacc27e51, NAME => 'testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:12:51,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:51,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:51,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f804f874f297fddf7bef66de6f634011, disabling compactions & flushes 2023-07-16 01:12:51,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 78191c5e86349b2706b846dbacc27e51, disabling compactions & flushes 2023-07-16 01:12:51,663 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:12:51,663 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:12:51,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:12:51,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:12:51,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. after waiting 0 ms 2023-07-16 01:12:51,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. after waiting 0 ms 2023-07-16 01:12:51,664 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:12:51,664 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:12:51,664 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:12:51,664 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:12:51,664 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 78191c5e86349b2706b846dbacc27e51: 2023-07-16 01:12:51,664 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f804f874f297fddf7bef66de6f634011: 2023-07-16 01:12:51,667 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:12:51,668 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469971668"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469971668"}]},"ts":"1689469971668"} 2023-07-16 01:12:51,668 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469971668"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469971668"}]},"ts":"1689469971668"} 2023-07-16 01:12:51,670 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:12:51,671 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:12:51,671 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469971671"}]},"ts":"1689469971671"} 2023-07-16 01:12:51,672 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 01:12:51,675 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:12:51,676 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:12:51,677 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:12:51,677 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:12:51,677 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:12:51,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=78191c5e86349b2706b846dbacc27e51, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f804f874f297fddf7bef66de6f634011, ASSIGN}] 2023-07-16 01:12:51,679 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f804f874f297fddf7bef66de6f634011, ASSIGN 2023-07-16 01:12:51,680 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=78191c5e86349b2706b846dbacc27e51, ASSIGN 2023-07-16 01:12:51,680 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f804f874f297fddf7bef66de6f634011, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45775,1689469866515; forceNewPlan=false, retain=false 2023-07-16 01:12:51,681 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=78191c5e86349b2706b846dbacc27e51, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41029,1689469866571; forceNewPlan=false, retain=false 2023-07-16 01:12:51,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 01:12:51,830 INFO [jenkins-hbase4:39271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:12:51,834 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f804f874f297fddf7bef66de6f634011, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:51,834 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=78191c5e86349b2706b846dbacc27e51, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:51,834 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469971834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469971834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469971834"}]},"ts":"1689469971834"} 2023-07-16 01:12:51,834 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469971834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469971834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469971834"}]},"ts":"1689469971834"} 2023-07-16 01:12:51,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure f804f874f297fddf7bef66de6f634011, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:12:51,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 78191c5e86349b2706b846dbacc27e51, server=jenkins-hbase4.apache.org,41029,1689469866571}] 2023-07-16 01:12:51,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 01:12:51,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:12:51,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f804f874f297fddf7bef66de6f634011, NAME => 'testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 01:12:51,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:12:51,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. service=AccessControlService 2023-07-16 01:12:51,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 78191c5e86349b2706b846dbacc27e51, NAME => 'testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 01:12:51,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:51,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. service=AccessControlService 2023-07-16 01:12:51,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f804f874f297fddf7bef66de6f634011 2023-07-16 01:12:51,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:51,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:12:51,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f804f874f297fddf7bef66de6f634011 2023-07-16 01:12:51,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f804f874f297fddf7bef66de6f634011 2023-07-16 01:12:51,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 78191c5e86349b2706b846dbacc27e51 2023-07-16 01:12:51,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:12:51,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 78191c5e86349b2706b846dbacc27e51 2023-07-16 01:12:51,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 78191c5e86349b2706b846dbacc27e51 2023-07-16 01:12:51,993 INFO [StoreOpener-f804f874f297fddf7bef66de6f634011-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f804f874f297fddf7bef66de6f634011 2023-07-16 01:12:51,993 INFO [StoreOpener-78191c5e86349b2706b846dbacc27e51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 78191c5e86349b2706b846dbacc27e51 2023-07-16 01:12:51,995 DEBUG [StoreOpener-78191c5e86349b2706b846dbacc27e51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/cf 2023-07-16 01:12:51,995 DEBUG [StoreOpener-78191c5e86349b2706b846dbacc27e51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/cf 2023-07-16 01:12:51,996 DEBUG [StoreOpener-f804f874f297fddf7bef66de6f634011-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/cf 2023-07-16 01:12:51,996 DEBUG [StoreOpener-f804f874f297fddf7bef66de6f634011-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/cf 2023-07-16 01:12:51,996 INFO [StoreOpener-78191c5e86349b2706b846dbacc27e51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78191c5e86349b2706b846dbacc27e51 columnFamilyName cf 2023-07-16 01:12:51,996 INFO [StoreOpener-f804f874f297fddf7bef66de6f634011-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f804f874f297fddf7bef66de6f634011 columnFamilyName cf 2023-07-16 01:12:51,997 INFO [StoreOpener-f804f874f297fddf7bef66de6f634011-1] regionserver.HStore(310): Store=f804f874f297fddf7bef66de6f634011/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:51,997 INFO [StoreOpener-78191c5e86349b2706b846dbacc27e51-1] regionserver.HStore(310): Store=78191c5e86349b2706b846dbacc27e51/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:12:51,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011 2023-07-16 01:12:51,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51 2023-07-16 01:12:51,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011 2023-07-16 01:12:51,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51 2023-07-16 01:12:52,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 78191c5e86349b2706b846dbacc27e51 2023-07-16 01:12:52,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:12:52,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 78191c5e86349b2706b846dbacc27e51; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74962144, jitterRate=0.11702299118041992}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:52,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 78191c5e86349b2706b846dbacc27e51: 2023-07-16 01:12:52,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51., pid=94, masterSystemTime=1689469971988 2023-07-16 01:12:52,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:12:52,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:12:52,007 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=78191c5e86349b2706b846dbacc27e51, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,007 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469972007"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469972007"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469972007"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469972007"}]},"ts":"1689469972007"} 2023-07-16 01:12:52,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-16 01:12:52,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 78191c5e86349b2706b846dbacc27e51, server=jenkins-hbase4.apache.org,41029,1689469866571 in 172 msec 2023-07-16 01:12:52,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=78191c5e86349b2706b846dbacc27e51, ASSIGN in 333 msec 2023-07-16 01:12:52,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f804f874f297fddf7bef66de6f634011 2023-07-16 01:12:52,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:12:52,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f804f874f297fddf7bef66de6f634011; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72010172, jitterRate=0.07303518056869507}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:12:52,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f804f874f297fddf7bef66de6f634011: 2023-07-16 01:12:52,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011., pid=93, masterSystemTime=1689469971987 2023-07-16 01:12:52,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:12:52,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:12:52,016 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f804f874f297fddf7bef66de6f634011, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,016 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469972016"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469972016"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469972016"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469972016"}]},"ts":"1689469972016"} 2023-07-16 01:12:52,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-16 01:12:52,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure f804f874f297fddf7bef66de6f634011, server=jenkins-hbase4.apache.org,45775,1689469866515 in 182 msec 2023-07-16 01:12:52,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-16 01:12:52,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f804f874f297fddf7bef66de6f634011, ASSIGN in 342 msec 2023-07-16 01:12:52,021 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:12:52,021 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469972021"}]},"ts":"1689469972021"} 2023-07-16 01:12:52,023 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 01:12:52,026 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:12:52,026 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-16 01:12:52,028 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 01:12:52,029 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:52,029 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:52,029 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:52,029 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:12:52,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:52,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:52,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:52,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 01:12:52,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 460 msec 2023-07-16 01:12:52,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 01:12:52,210 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-16 01:12:52,210 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-16 01:12:52,210 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:12:52,213 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-16 01:12:52,214 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:12:52,214 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-16 01:12:52,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:12:52,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469972216 (current time:1689469972216). 2023-07-16 01:12:52,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:12:52,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x4c2d3875 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:52,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7efa0ddb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:52,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:52,231 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:52,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c2d3875 to 127.0.0.1:64468 2023-07-16 01:12:52,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:52,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x70380ded to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:52,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55f36d0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:52,339 DEBUG [hconnection-0x7bc936bf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:52,344 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:52,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:52,353 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:52,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70380ded to 127.0.0.1:64468 2023-07-16 01:12:52,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:52,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 01:12:52,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:12:52,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:12:52,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:12:52,359 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:12:52,359 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689470572359 2023-07-16 01:12:52,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 01:12:52,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:12:52,361 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:12:52,361 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:12:52,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 01:12:52,364 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:12:52,365 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-16 01:12:52,368 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 01:12:52,369 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689470572369 2023-07-16 01:12:52,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,387 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-16 01:12:52,388 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:52,389 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 01:12:52,389 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 01:12:52,389 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,389 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,396 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:52,396 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:52,396 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:52,396 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:52,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:52,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:52,396 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:52,396 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,398 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,399 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:12:52,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 01:12:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 01:12:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,399 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 01:12:52,399 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 01:12:52,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,400 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 01:12:52,400 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:52,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,401 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 01:12:52,401 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 01:12:52,401 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 01:12:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 01:12:52,401 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,401 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 01:12:52,402 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 01:12:52,403 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 01:12:52,403 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 01:12:52,403 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 01:12:52,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,403 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 01:12:52,403 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:52,404 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 01:12:52,404 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 01:12:52,404 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 01:12:52,406 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,406 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,406 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,406 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:52,406 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:52,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:52,409 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,409 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:52,411 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,411 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:52,411 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,411 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:52,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:52,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:52,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 01:12:52,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@449f922c[Count = 1] remaining members to acquire global barrier 2023-07-16 01:12:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:52,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:52,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:52,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 01:12:52,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@449f922c[Count = 0] remaining members to acquire global barrier 2023-07-16 01:12:52,415 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 01:12:52,415 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,417 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,417 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,417 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:12:52,417 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:12:52,417 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,417 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:52,417 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:52,417 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,417 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:12:52,417 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. started... 2023-07-16 01:12:52,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,417 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 01:12:52,418 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:12:52,418 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:12:52,419 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,419 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:12:52,419 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f804f874f297fddf7bef66de6f634011: 2023-07-16 01:12:52,423 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,424 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:52,424 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:12:52,420 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:12:52,419 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:52,424 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:52,424 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. started... 2023-07-16 01:12:52,426 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78191c5e86349b2706b846dbacc27e51: 2023-07-16 01:12:52,426 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,426 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:52,426 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:12:52,426 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 01:12:52,426 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:52,426 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 01:12:52,450 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. completed. 2023-07-16 01:12:52,450 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. completed. 2023-07-16 01:12:52,450 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:12:52,450 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:12:52,450 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:52,451 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:52,451 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,450 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:52,451 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:52,451 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 01:12:52,451 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,451 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:12:52,451 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 01:12:52,451 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:12:52,452 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,452 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 01:12:52,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,453 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 01:12:52,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:52,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:52,453 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:52,452 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:52,453 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 01:12:52,453 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,453 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 01:12:52,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:52,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:52,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:52,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45775,1689469866515': 2023-07-16 01:12:52,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 01:12:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:52,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:52,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,461 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:52,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:12:52,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:52,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,463 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:12:52,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41029,1689469866571': 2023-07-16 01:12:52,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 01:12:52,465 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 01:12:52,465 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:12:52,465 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:12:52,465 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,465 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:12:52,468 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,468 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,468 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:52,468 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,468 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:52,468 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:52,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:52,469 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:52,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,469 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:52,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:52,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:52,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:52,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:52,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:52,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:52,470 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,470 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,472 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:52,472 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,473 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,475 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,475 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:52,475 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,476 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:52,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:52,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,476 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:52,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:52,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:52,476 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:52,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:52,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:52,476 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:52,476 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:52,476 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,476 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:52,478 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:52,478 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:52,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:52,478 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:52,478 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,478 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,478 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,478 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:52,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,478 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,543 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 01:12:52,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,544 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689469972360Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689469972476 (+116 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689469972476Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689469972484 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689469972498 (+14 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689469972543 (+45 ms) 2023-07-16 01:12:52,548 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 01:12:52,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 188 msec 2023-07-16 01:12:52,663 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:52,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:12:52,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:12:52,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41029] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:12:52,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45775] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:12:52,697 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-16 01:12:52,698 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:12:52,698 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:12:52,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:12:52,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469972721 (current time:1689469972721). 2023-07-16 01:12:52,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:12:52,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x6b4670e4 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:52,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5908dffd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:52,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:52,746 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:52,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b4670e4 to 127.0.0.1:64468 2023-07-16 01:12:52,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:52,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x50672f29 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:12:52,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@87ea491, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:12:52,792 DEBUG [hconnection-0x17166554-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:52,804 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:52,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:12:52,813 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:12:52,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50672f29 to 127.0.0.1:64468 2023-07-16 01:12:52,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:12:52,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 01:12:52,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:12:52,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:12:52,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:12:52,819 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:12:52,819 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689470572819 2023-07-16 01:12:52,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 01:12:52,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 01:12:52,821 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:12:52,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 01:12:52,822 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:12:52,822 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 01:12:52,823 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-16 01:12:52,825 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 01:12:52,825 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689470572825 2023-07-16 01:12:52,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,837 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-16 01:12:52,837 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:52,838 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 01:12:52,838 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 01:12:52,839 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,839 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,840 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:52,840 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:52,840 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:52,840 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:52,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:52,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:52,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:52,841 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:52,841 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:52,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,842 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,842 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:12:52,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 01:12:52,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,842 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 01:12:52,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 01:12:52,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,843 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 01:12:52,843 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 01:12:52,843 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:52,844 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 01:12:52,844 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 01:12:52,845 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 01:12:52,845 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,845 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 01:12:52,845 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:52,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 01:12:52,846 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 01:12:52,846 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 01:12:52,846 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 01:12:52,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,846 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 01:12:52,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,846 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 01:12:52,846 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:12:52,850 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 01:12:52,850 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 01:12:52,850 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 01:12:52,850 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,850 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:52,852 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,852 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,853 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:52,852 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,853 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:52,853 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,853 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:52,854 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,854 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:12:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:52,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 01:12:52,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b70c75[Count = 1] remaining members to acquire global barrier 2023-07-16 01:12:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:52,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:52,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 01:12:52,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b70c75[Count = 0] remaining members to acquire global barrier 2023-07-16 01:12:52,858 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 01:12:52,858 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,862 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,862 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,862 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,862 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,862 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:12:52,862 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:12:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,863 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 01:12:52,863 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 01:12:52,863 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:12:52,863 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,863 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:12:52,864 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 01:12:52,864 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:52,864 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 01:12:52,875 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:52,875 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:12:52,875 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:12:52,875 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. started... 2023-07-16 01:12:52,875 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:12:52,875 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. started... 2023-07-16 01:12:52,875 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 78191c5e86349b2706b846dbacc27e51 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-16 01:12:52,875 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:52,875 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:12:52,875 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f804f874f297fddf7bef66de6f634011 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-16 01:12:52,897 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/.tmp/cf/c87552c22bc2494395fb14007ef83ec8 2023-07-16 01:12:52,900 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/.tmp/cf/cdba1f03d8f746f09e5014e4011ca2f6 2023-07-16 01:12:52,905 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/.tmp/cf/c87552c22bc2494395fb14007ef83ec8 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/cf/c87552c22bc2494395fb14007ef83ec8 2023-07-16 01:12:52,908 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/.tmp/cf/cdba1f03d8f746f09e5014e4011ca2f6 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/cf/cdba1f03d8f746f09e5014e4011ca2f6 2023-07-16 01:12:52,912 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/cf/c87552c22bc2494395fb14007ef83ec8, entries=4, sequenceid=6, filesize=5.1 K 2023-07-16 01:12:52,913 INFO [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 78191c5e86349b2706b846dbacc27e51 in 38ms, sequenceid=6, compaction requested=false 2023-07-16 01:12:52,913 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-16 01:12:52,913 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78191c5e86349b2706b846dbacc27e51: 2023-07-16 01:12:52,913 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,913 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:52,913 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/cf/cdba1f03d8f746f09e5014e4011ca2f6, entries=46, sequenceid=6, filesize=7.9 K 2023-07-16 01:12:52,913 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/cf/c87552c22bc2494395fb14007ef83ec8] hfiles 2023-07-16 01:12:52,914 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/cf/c87552c22bc2494395fb14007ef83ec8 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,914 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for f804f874f297fddf7bef66de6f634011 in 39ms, sequenceid=6, compaction requested=false 2023-07-16 01:12:52,916 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f804f874f297fddf7bef66de6f634011: 2023-07-16 01:12:52,916 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,916 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:12:52,916 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/cf/cdba1f03d8f746f09e5014e4011ca2f6] hfiles 2023-07-16 01:12:52,916 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/cf/cdba1f03d8f746f09e5014e4011ca2f6 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,922 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:52,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:12:52,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:52,924 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:12:52,932 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. completed. 2023-07-16 01:12:52,932 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:12:52,932 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:52,932 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:52,932 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,932 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 01:12:52,932 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:12:52,932 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. completed. 2023-07-16 01:12:52,932 DEBUG [rs(jenkins-hbase4.apache.org,41029,1689469866571)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:12:52,932 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:12:52,932 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:12:52,933 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,933 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 01:12:52,933 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:12:52,934 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,934 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 01:12:52,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:52,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:52,934 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:52,934 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 01:12:52,938 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 01:12:52,938 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,938 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:52,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:52,938 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 01:12:52,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45775,1689469866515': 2023-07-16 01:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 01:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:52,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:52,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:52,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:52,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41029,1689469866571': 2023-07-16 01:12:52,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 01:12:52,947 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 01:12:52,947 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:12:52,947 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:12:52,947 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,947 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:12:52,949 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,949 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,949 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,949 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,949 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:52,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,949 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:52,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:12:52,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:12:52,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,949 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:52,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:12:52,950 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:52,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:52,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:52,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:52,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:52,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:52,950 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:12:52,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,951 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:12:52,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,953 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,953 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,953 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,956 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:52,956 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:52,956 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:52,956 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,956 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:12:52,957 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:52,957 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:52,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:52,957 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:12:52,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:12:52,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:52,956 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:12:52,957 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:52,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:12:52,957 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,959 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:52,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:52,959 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,959 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:12:52,959 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:52,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:52,959 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:12:52,959 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:12:52,959 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,959 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:52,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:12:52,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:12:52,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:53,124 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:53,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:12:53,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:53,125 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:12:53,425 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:53,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:12:53,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:12:53,427 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 01:12:53,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 01:12:53,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:53,451 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:53,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689469972820Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689469972958 (+138 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689469972958Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689469972963 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689469972974 (+11 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689469973450 (+476 ms) 2023-07-16 01:12:53,454 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 01:12:53,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 633 msec 2023-07-16 01:12:53,927 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:12:53,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 01:12:53,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:12:53,928 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469973928 2023-07-16 01:12:53,929 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40869, tgtDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469973928, rawTgtDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469973928, srcFsUri=hdfs://localhost:40869, srcDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:12:53,957 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:12:53,957 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2081533483_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469973928, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469973928/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:53,957 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5, snapshotDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-16 01:12:53,964 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469973928/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:12:53,998 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:53,998 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:53,998 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:53,999 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:55,173 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-3912776401114444912.jar 2023-07-16 01:12:55,174 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:55,174 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:55,259 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-2572967227950618935.jar 2023-07-16 01:12:55,260 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:55,261 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:55,261 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:55,262 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:55,262 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:55,263 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:12:55,263 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:12:55,264 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:12:55,264 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:12:55,265 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:12:55,265 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:12:55,266 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:12:55,266 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:12:55,267 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:12:55,267 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:12:55,268 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:12:55,268 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:55,269 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:55,269 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:55,270 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:55,270 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:12:55,271 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:55,271 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:12:55,751 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0005_000001 (auth:SIMPLE) 2023-07-16 01:12:56,483 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:12:56,732 WARN [Listener at jenkins-hbase4.apache.org/39957] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:12:56,735 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-16 01:12:56,870 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:12:56,870 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:12:57,756 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0006_000001 (auth:SIMPLE) 2023-07-16 01:13:04,343 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0006_000001 (auth:SIMPLE) 2023-07-16 01:13:07,223 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:13:07,224 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:13:07,252 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:13:07,252 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:13:07,256 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:13:07,256 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1398488159_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:13:07,258 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 01:13:07,258 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 01:13:07,258 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1398488159_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469973928/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469973928/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:13:07,259 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469973928/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 01:13:07,259 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469973928/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 01:13:07,267 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 01:13:07,274 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469987274"}]},"ts":"1689469987274"} 2023-07-16 01:13:07,276 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 01:13:07,277 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-16 01:13:07,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=78191c5e86349b2706b846dbacc27e51, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f804f874f297fddf7bef66de6f634011, UNASSIGN}] 2023-07-16 01:13:07,285 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f804f874f297fddf7bef66de6f634011, UNASSIGN 2023-07-16 01:13:07,288 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=78191c5e86349b2706b846dbacc27e51, UNASSIGN 2023-07-16 01:13:07,290 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f804f874f297fddf7bef66de6f634011, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:07,290 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=78191c5e86349b2706b846dbacc27e51, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:07,291 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469987290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469987290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469987290"}]},"ts":"1689469987290"} 2023-07-16 01:13:07,291 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469987290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469987290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469987290"}]},"ts":"1689469987290"} 2023-07-16 01:13:07,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure f804f874f297fddf7bef66de6f634011, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:13:07,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 78191c5e86349b2706b846dbacc27e51, server=jenkins-hbase4.apache.org,41029,1689469866571}] 2023-07-16 01:13:07,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 01:13:07,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f804f874f297fddf7bef66de6f634011 2023-07-16 01:13:07,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 78191c5e86349b2706b846dbacc27e51 2023-07-16 01:13:07,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f804f874f297fddf7bef66de6f634011, disabling compactions & flushes 2023-07-16 01:13:07,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 78191c5e86349b2706b846dbacc27e51, disabling compactions & flushes 2023-07-16 01:13:07,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:13:07,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:13:07,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:13:07,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:13:07,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. after waiting 0 ms 2023-07-16 01:13:07,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. after waiting 0 ms 2023-07-16 01:13:07,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:13:07,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:13:07,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:13:07,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:13:07,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:07,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011. 2023-07-16 01:13:07,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f804f874f297fddf7bef66de6f634011: 2023-07-16 01:13:07,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:07,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51. 2023-07-16 01:13:07,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 78191c5e86349b2706b846dbacc27e51: 2023-07-16 01:13:07,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f804f874f297fddf7bef66de6f634011 2023-07-16 01:13:07,477 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f804f874f297fddf7bef66de6f634011, regionState=CLOSED 2023-07-16 01:13:07,477 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469987477"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469987477"}]},"ts":"1689469987477"} 2023-07-16 01:13:07,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 78191c5e86349b2706b846dbacc27e51 2023-07-16 01:13:07,478 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=78191c5e86349b2706b846dbacc27e51, regionState=CLOSED 2023-07-16 01:13:07,478 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689469987478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469987478"}]},"ts":"1689469987478"} 2023-07-16 01:13:07,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-16 01:13:07,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure f804f874f297fddf7bef66de6f634011, server=jenkins-hbase4.apache.org,45775,1689469866515 in 179 msec 2023-07-16 01:13:07,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-16 01:13:07,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 78191c5e86349b2706b846dbacc27e51, server=jenkins-hbase4.apache.org,41029,1689469866571 in 178 msec 2023-07-16 01:13:07,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f804f874f297fddf7bef66de6f634011, UNASSIGN in 200 msec 2023-07-16 01:13:07,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-16 01:13:07,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=78191c5e86349b2706b846dbacc27e51, UNASSIGN in 201 msec 2023-07-16 01:13:07,486 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469987486"}]},"ts":"1689469987486"} 2023-07-16 01:13:07,487 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 01:13:07,489 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-16 01:13:07,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 222 msec 2023-07-16 01:13:07,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 01:13:07,576 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-16 01:13:07,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,581 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,582 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,583 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,587 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,587 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,587 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51 2023-07-16 01:13:07,587 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,587 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,587 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011 2023-07-16 01:13:07,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 01:13:07,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 01:13:07,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 01:13:07,588 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 01:13:07,589 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,589 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,589 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:07,589 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,589 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:07,589 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,590 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:07,589 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:07,590 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/recovered.edits] 2023-07-16 01:13:07,590 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/recovered.edits] 2023-07-16 01:13:07,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 01:13:07,594 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/cf/c87552c22bc2494395fb14007ef83ec8 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/cf/c87552c22bc2494395fb14007ef83ec8 2023-07-16 01:13:07,595 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/cf/cdba1f03d8f746f09e5014e4011ca2f6 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/cf/cdba1f03d8f746f09e5014e4011ca2f6 2023-07-16 01:13:07,598 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/recovered.edits/9.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51/recovered.edits/9.seqid 2023-07-16 01:13:07,599 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/recovered.edits/9.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011/recovered.edits/9.seqid 2023-07-16 01:13:07,599 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/78191c5e86349b2706b846dbacc27e51 2023-07-16 01:13:07,599 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testEmptyExportFileSystemState/f804f874f297fddf7bef66de6f634011 2023-07-16 01:13:07,599 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 01:13:07,601 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,603 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-16 01:13:07,607 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-16 01:13:07,608 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,608 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-16 01:13:07,608 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469987608"}]},"ts":"9223372036854775807"} 2023-07-16 01:13:07,608 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689469987608"}]},"ts":"9223372036854775807"} 2023-07-16 01:13:07,610 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 01:13:07,610 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 78191c5e86349b2706b846dbacc27e51, NAME => 'testtb-testEmptyExportFileSystemState,,1689469971570.78191c5e86349b2706b846dbacc27e51.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f804f874f297fddf7bef66de6f634011, NAME => 'testtb-testEmptyExportFileSystemState,1,1689469971570.f804f874f297fddf7bef66de6f634011.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 01:13:07,610 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-16 01:13:07,610 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689469987610"}]},"ts":"9223372036854775807"} 2023-07-16 01:13:07,611 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-16 01:13:07,613 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 01:13:07,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 36 msec 2023-07-16 01:13:07,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 01:13:07,692 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-16 01:13:07,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-16 01:13:07,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 01:13:07,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-16 01:13:07,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-16 01:13:07,733 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 764) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:34839 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:59858 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1614051779_1 at /127.0.0.1:52092 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1614051779_1 at /127.0.0.1:59832 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4834 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:48112 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:52112 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:43499 from appattempt_1689469875738_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=907 (was 909), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=532 (was 560), ProcessCount=184 (was 184), AvailableMemoryMB=1730 (was 2280) 2023-07-16 01:13:07,733 WARN [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-16 01:13:07,758 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=532, ProcessCount=184, AvailableMemoryMB=1729 2023-07-16 01:13:07,758 WARN [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-16 01:13:07,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 01:13:07,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:07,777 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 01:13:07,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-16 01:13:07,779 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 01:13:07,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 01:13:07,781 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:07,781 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:07,782 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2 empty. 2023-07-16 01:13:07,782 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241 empty. 2023-07-16 01:13:07,783 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:07,783 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:07,783 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 01:13:07,809 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-16 01:13:07,810 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 39282883deb7db187f42d96fe1ce2241, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:13:07,810 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 94295b6fc0dcc0566c7b5cca1b25dab2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp 2023-07-16 01:13:07,855 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:13:07,855 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 94295b6fc0dcc0566c7b5cca1b25dab2, disabling compactions & flushes 2023-07-16 01:13:07,855 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:07,855 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:07,855 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. after waiting 0 ms 2023-07-16 01:13:07,855 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:07,855 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:07,855 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 94295b6fc0dcc0566c7b5cca1b25dab2: 2023-07-16 01:13:07,858 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:13:07,858 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 39282883deb7db187f42d96fe1ce2241, disabling compactions & flushes 2023-07-16 01:13:07,858 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:07,858 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:07,858 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. after waiting 0 ms 2023-07-16 01:13:07,858 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:07,858 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:07,858 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 39282883deb7db187f42d96fe1ce2241: 2023-07-16 01:13:07,862 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 01:13:07,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689469987863"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469987863"}]},"ts":"1689469987863"} 2023-07-16 01:13:07,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689469987863"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689469987863"}]},"ts":"1689469987863"} 2023-07-16 01:13:07,865 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 01:13:07,866 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 01:13:07,867 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469987866"}]},"ts":"1689469987866"} 2023-07-16 01:13:07,868 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-16 01:13:07,871 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 01:13:07,873 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 01:13:07,873 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 01:13:07,873 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 01:13:07,873 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 01:13:07,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=39282883deb7db187f42d96fe1ce2241, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94295b6fc0dcc0566c7b5cca1b25dab2, ASSIGN}] 2023-07-16 01:13:07,880 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94295b6fc0dcc0566c7b5cca1b25dab2, ASSIGN 2023-07-16 01:13:07,880 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=39282883deb7db187f42d96fe1ce2241, ASSIGN 2023-07-16 01:13:07,880 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94295b6fc0dcc0566c7b5cca1b25dab2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45775,1689469866515; forceNewPlan=false, retain=false 2023-07-16 01:13:07,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 01:13:07,881 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=39282883deb7db187f42d96fe1ce2241, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39681,1689469866446; forceNewPlan=false, retain=false 2023-07-16 01:13:08,031 INFO [jenkins-hbase4:39271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 01:13:08,034 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=94295b6fc0dcc0566c7b5cca1b25dab2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,035 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689469988034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469988034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469988034"}]},"ts":"1689469988034"} 2023-07-16 01:13:08,035 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=39282883deb7db187f42d96fe1ce2241, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,035 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689469988035"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689469988035"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689469988035"}]},"ts":"1689469988035"} 2023-07-16 01:13:08,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 94295b6fc0dcc0566c7b5cca1b25dab2, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:13:08,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 39282883deb7db187f42d96fe1ce2241, server=jenkins-hbase4.apache.org,39681,1689469866446}] 2023-07-16 01:13:08,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 01:13:08,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:08,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 94295b6fc0dcc0566c7b5cca1b25dab2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 01:13:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 39282883deb7db187f42d96fe1ce2241, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 01:13:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. service=AccessControlService 2023-07-16 01:13:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. service=AccessControlService 2023-07-16 01:13:08,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:13:08,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 01:13:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:08,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:13:08,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:08,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 01:13:08,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:08,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:08,204 INFO [StoreOpener-39282883deb7db187f42d96fe1ce2241-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:08,204 INFO [StoreOpener-94295b6fc0dcc0566c7b5cca1b25dab2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:08,206 DEBUG [StoreOpener-94295b6fc0dcc0566c7b5cca1b25dab2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/cf 2023-07-16 01:13:08,206 DEBUG [StoreOpener-94295b6fc0dcc0566c7b5cca1b25dab2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/cf 2023-07-16 01:13:08,206 INFO [StoreOpener-94295b6fc0dcc0566c7b5cca1b25dab2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94295b6fc0dcc0566c7b5cca1b25dab2 columnFamilyName cf 2023-07-16 01:13:08,207 DEBUG [StoreOpener-39282883deb7db187f42d96fe1ce2241-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/cf 2023-07-16 01:13:08,207 DEBUG [StoreOpener-39282883deb7db187f42d96fe1ce2241-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/cf 2023-07-16 01:13:08,207 INFO [StoreOpener-39282883deb7db187f42d96fe1ce2241-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39282883deb7db187f42d96fe1ce2241 columnFamilyName cf 2023-07-16 01:13:08,208 INFO [StoreOpener-39282883deb7db187f42d96fe1ce2241-1] regionserver.HStore(310): Store=39282883deb7db187f42d96fe1ce2241/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:13:08,208 INFO [StoreOpener-94295b6fc0dcc0566c7b5cca1b25dab2-1] regionserver.HStore(310): Store=94295b6fc0dcc0566c7b5cca1b25dab2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 01:13:08,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:08,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:08,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:08,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:08,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:08,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:08,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:13:08,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 94295b6fc0dcc0566c7b5cca1b25dab2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62514587, jitterRate=-0.06846006214618683}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:13:08,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 94295b6fc0dcc0566c7b5cca1b25dab2: 2023-07-16 01:13:08,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2., pid=108, masterSystemTime=1689469988190 2023-07-16 01:13:08,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:08,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:08,219 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=94295b6fc0dcc0566c7b5cca1b25dab2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,220 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689469988219"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469988219"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469988219"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469988219"}]},"ts":"1689469988219"} 2023-07-16 01:13:08,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 01:13:08,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-16 01:13:08,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 94295b6fc0dcc0566c7b5cca1b25dab2, server=jenkins-hbase4.apache.org,45775,1689469866515 in 183 msec 2023-07-16 01:13:08,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 39282883deb7db187f42d96fe1ce2241; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70216323, jitterRate=0.046304747462272644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 01:13:08,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 39282883deb7db187f42d96fe1ce2241: 2023-07-16 01:13:08,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241., pid=109, masterSystemTime=1689469988190 2023-07-16 01:13:08,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94295b6fc0dcc0566c7b5cca1b25dab2, ASSIGN in 350 msec 2023-07-16 01:13:08,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:08,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:08,226 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=39282883deb7db187f42d96fe1ce2241, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,227 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689469988226"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689469988226"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689469988226"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689469988226"}]},"ts":"1689469988226"} 2023-07-16 01:13:08,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-16 01:13:08,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 39282883deb7db187f42d96fe1ce2241, server=jenkins-hbase4.apache.org,39681,1689469866446 in 189 msec 2023-07-16 01:13:08,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-16 01:13:08,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=39282883deb7db187f42d96fe1ce2241, ASSIGN in 357 msec 2023-07-16 01:13:08,232 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 01:13:08,232 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689469988232"}]},"ts":"1689469988232"} 2023-07-16 01:13:08,233 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-16 01:13:08,236 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 01:13:08,236 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-16 01:13:08,238 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 01:13:08,240 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:08,240 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:08,240 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:08,240 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:08,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 01:13:08,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 01:13:08,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 01:13:08,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 01:13:08,244 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 474 msec 2023-07-16 01:13:08,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 01:13:08,383 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-16 01:13:08,383 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-16 01:13:08,384 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:13:08,388 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-16 01:13:08,388 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:13:08,388 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-16 01:13:08,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 01:13:08,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469988391 (current time:1689469988391). 2023-07-16 01:13:08,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:13:08,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x54334b15 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:13:08,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@538a8e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:13:08,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:13:08,422 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:13:08,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54334b15 to 127.0.0.1:64468 2023-07-16 01:13:08,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:08,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x3f3b246a to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:13:08,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@719ebb7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:13:08,438 DEBUG [hconnection-0x31216200-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:13:08,443 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:13:08,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:13:08,451 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:13:08,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f3b246a to 127.0.0.1:64468 2023-07-16 01:13:08,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:08,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 01:13:08,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:13:08,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 01:13:08,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 01:13:08,459 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 01:13:08,460 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689470588460 2023-07-16 01:13:08,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 01:13:08,460 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,462 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:13:08,462 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:13:08,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 01:13:08,463 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 01:13:08,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-16 01:13:08,465 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 01:13:08,466 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689470588466 2023-07-16 01:13:08,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,484 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 01:13:08,484 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:08,486 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 01:13:08,486 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 01:13:08,486 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,486 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,488 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:08,488 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:08,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:08,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:08,488 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:08,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:08,488 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,489 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,489 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 01:13:08,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,490 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,490 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:13:08,490 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 01:13:08,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,490 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 01:13:08,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 01:13:08,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,491 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 01:13:08,490 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:08,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 01:13:08,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,494 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 01:13:08,495 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,495 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 01:13:08,495 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:08,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,501 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 01:13:08,501 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:08,500 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 01:13:08,502 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 01:13:08,502 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 01:13:08,500 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 01:13:08,503 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 01:13:08,503 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 01:13:08,503 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 01:13:08,503 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 01:13:08,503 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 01:13:08,510 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,510 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,511 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,511 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:08,512 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,512 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,512 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,512 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:13:08,512 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:13:08,513 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:08,513 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:13:08,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:08,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:08,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:08,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 01:13:08,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c813c8f[Count = 1] remaining members to acquire global barrier 2023-07-16 01:13:08,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:08,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:08,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:08,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 01:13:08,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c813c8f[Count = 0] remaining members to acquire global barrier 2023-07-16 01:13:08,519 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 01:13:08,519 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,521 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,521 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,522 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,522 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 01:13:08,522 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 01:13:08,522 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,522 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:13:08,522 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,523 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 01:13:08,523 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 01:13:08,523 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:13:08,524 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 01:13:08,524 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:08,524 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 01:13:08,526 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:13:08,529 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:13:08,529 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:13:08,529 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:08,530 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. started... 2023-07-16 01:13:08,529 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:08,529 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:13:08,530 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. started... 2023-07-16 01:13:08,533 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 39282883deb7db187f42d96fe1ce2241: 2023-07-16 01:13:08,533 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,533 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:13:08,533 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:13:08,534 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 94295b6fc0dcc0566c7b5cca1b25dab2: 2023-07-16 01:13:08,535 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,535 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:13:08,535 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 01:13:08,562 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:13:08,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 01:13:08,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:13:08,564 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:13:08,590 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. completed. 2023-07-16 01:13:08,590 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:08,590 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:13:08,590 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:13:08,590 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,590 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 01:13:08,590 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:13:08,593 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,593 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 01:13:08,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:08,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:08,593 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:08,594 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 01:13:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:08,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45775,1689469866515': 2023-07-16 01:13:08,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 01:13:08,764 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:13:08,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 01:13:08,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:13:08,765 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 01:13:08,854 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-16 01:13:08,979 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. completed. 2023-07-16 01:13:08,979 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:08,979 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:13:08,979 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:13:08,979 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,979 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 01:13:08,979 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:13:08,981 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,981 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 01:13:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:08,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:08,981 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:08,981 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 01:13:08,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:08,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:08,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:08,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:08,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:08,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39681,1689469866446': 2023-07-16 01:13:08,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 01:13:08,987 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 01:13:08,987 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:13:08,987 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:13:08,987 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,987 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:13:08,991 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,991 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,991 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,992 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,992 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:08,992 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,992 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,992 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:08,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:08,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:08,993 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,993 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:08,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:08,995 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:08,995 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,995 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:08,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:08,998 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:08,998 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:08,998 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:08,998 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:08,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:08,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:08,998 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:08,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:08,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:08,998 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:08,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,998 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:08,998 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:08,998 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:08,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:08,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:08,998 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:08,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:09,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:08,999 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:09,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:09,001 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,001 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:09,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:09,001 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,001 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,001 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,001 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,001 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,036 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 01:13:09,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,037 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689469988460Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689469988998 (+538 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689469988999 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689469989003 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689469989014 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689469989036 (+22 ms) 2023-07-16 01:13:09,040 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 01:13:09,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 578 msec 2023-07-16 01:13:09,065 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:13:09,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 01:13:09,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:13:09,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39681] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:13:09,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45775] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 01:13:09,082 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,082 DEBUG [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:09,082 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 01:13:09,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 01:13:09,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689469989098 (current time:1689469989098). 2023-07-16 01:13:09,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 01:13:09,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x37c73574 to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:13:09,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d4c60ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:13:09,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:13:09,112 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:13:09,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37c73574 to 127.0.0.1:64468 2023-07-16 01:13:09,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:09,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(139): Connect 0x1812577f to 127.0.0.1:64468 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 01:13:09,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1670ad9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 01:13:09,123 DEBUG [hconnection-0x78d5f4ac-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:13:09,126 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:13:09,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 01:13:09,132 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 01:13:09,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1812577f to 127.0.0.1:64468 2023-07-16 01:13:09,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:09,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 01:13:09,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 01:13:09,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 01:13:09,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 01:13:09,137 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 01:13:09,140 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689470589140 2023-07-16 01:13:09,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 01:13:09,142 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 01:13:09,142 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 01:13:09,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 01:13:09,143 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 01:13:09,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-16 01:13:09,145 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 01:13:09,145 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689470589145 2023-07-16 01:13:09,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,158 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 01:13:09,158 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:09,159 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 01:13:09,159 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 01:13:09,159 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,159 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,161 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:09,161 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:09,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:09,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:09,161 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:09,161 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,162 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,162 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,163 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 01:13:09,163 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 01:13:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 01:13:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 01:13:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 01:13:09,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 01:13:09,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 01:13:09,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,163 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 01:13:09,163 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 01:13:09,163 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:09,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,165 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 01:13:09,165 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 01:13:09,165 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 01:13:09,165 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 01:13:09,163 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:09,165 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 01:13:09,166 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 01:13:09,166 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 01:13:09,166 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 01:13:09,166 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 01:13:09,166 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 01:13:09,166 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41029,1689469866571' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 01:13:09,168 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,168 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:09,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:09,169 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,169 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,169 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,169 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:09,169 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:13:09,169 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,169 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,169 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:13:09,169 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 01:13:09,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:09,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:09,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39681,1689469866446' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 01:13:09,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fc0127f[Count = 1] remaining members to acquire global barrier 2023-07-16 01:13:09,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:09,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:09,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:09,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:09,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:09,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45775,1689469866515' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 01:13:09,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fc0127f[Count = 0] remaining members to acquire global barrier 2023-07-16 01:13:09,173 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 01:13:09,173 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,178 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,178 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,178 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,178 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,178 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 01:13:09,178 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 01:13:09,178 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 01:13:09,178 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41029,1689469866571' in zk 2023-07-16 01:13:09,178 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 01:13:09,178 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,179 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 01:13:09,179 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:13:09,179 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:13:09,178 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 01:13:09,179 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 01:13:09,179 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:09,179 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:09,179 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. started... 2023-07-16 01:13:09,179 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. started... 2023-07-16 01:13:09,179 INFO [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 39282883deb7db187f42d96fe1ce2241 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-16 01:13:09,179 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 94295b6fc0dcc0566c7b5cca1b25dab2 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-16 01:13:09,180 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 01:13:09,180 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:09,180 DEBUG [member: 'jenkins-hbase4.apache.org,41029,1689469866571' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 01:13:09,196 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/.tmp/cf/c8bb1a32380e41178e1ebb58ab533b35 2023-07-16 01:13:09,196 INFO [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/.tmp/cf/f295200c337f492dbccb5c5cee0dba20 2023-07-16 01:13:09,202 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/.tmp/cf/f295200c337f492dbccb5c5cee0dba20 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/cf/f295200c337f492dbccb5c5cee0dba20 2023-07-16 01:13:09,202 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/.tmp/cf/c8bb1a32380e41178e1ebb58ab533b35 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/cf/c8bb1a32380e41178e1ebb58ab533b35 2023-07-16 01:13:09,207 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/cf/c8bb1a32380e41178e1ebb58ab533b35, entries=45, sequenceid=6, filesize=7.9 K 2023-07-16 01:13:09,207 INFO [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/cf/f295200c337f492dbccb5c5cee0dba20, entries=5, sequenceid=6, filesize=5.2 K 2023-07-16 01:13:09,207 INFO [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 94295b6fc0dcc0566c7b5cca1b25dab2 in 28ms, sequenceid=6, compaction requested=false 2023-07-16 01:13:09,209 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 94295b6fc0dcc0566c7b5cca1b25dab2: 2023-07-16 01:13:09,209 INFO [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 39282883deb7db187f42d96fe1ce2241 in 30ms, sequenceid=6, compaction requested=false 2023-07-16 01:13:09,209 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,209 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 39282883deb7db187f42d96fe1ce2241: 2023-07-16 01:13:09,209 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:13:09,209 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/cf/c8bb1a32380e41178e1ebb58ab533b35] hfiles 2023-07-16 01:13:09,210 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,210 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/cf/c8bb1a32380e41178e1ebb58ab533b35 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,210 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 01:13:09,210 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/cf/f295200c337f492dbccb5c5cee0dba20] hfiles 2023-07-16 01:13:09,210 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/cf/f295200c337f492dbccb5c5cee0dba20 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,230 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. completed. 2023-07-16 01:13:09,230 DEBUG [rs(jenkins-hbase4.apache.org,45775,1689469866515)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:09,230 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. completed. 2023-07-16 01:13:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:13:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:13:09,230 DEBUG [rs(jenkins-hbase4.apache.org,39681,1689469866446)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 01:13:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 01:13:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,230 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 01:13:09,231 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 01:13:09,231 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39681,1689469866446' in zk 2023-07-16 01:13:09,231 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45775,1689469866515' in zk 2023-07-16 01:13:09,232 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,232 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 01:13:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:09,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:09,232 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:09,232 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,232 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 01:13:09,232 DEBUG [member: 'jenkins-hbase4.apache.org,45775,1689469866515' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 01:13:09,233 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:09,233 DEBUG [member: 'jenkins-hbase4.apache.org,39681,1689469866446' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 01:13:09,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:09,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:09,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39681,1689469866446': 2023-07-16 01:13:09,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39681,1689469866446' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 01:13:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45775,1689469866515': 2023-07-16 01:13:09,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45775,1689469866515' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 01:13:09,240 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 01:13:09,240 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 01:13:09,240 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 01:13:09,240 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,240 INFO [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 01:13:09,242 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,242 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,242 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:09,242 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,242 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,242 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:09,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 01:13:09,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 01:13:09,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,242 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:13:09,242 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,242 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:09,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 01:13:09,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:09,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:09,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:09,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:09,243 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 01:13:09,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 01:13:09,243 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 01:13:09,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,244 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 01:13:09,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 01:13:09,246 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,247 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,247 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:09,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:09,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:09,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:09,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:09,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:09,251 DEBUG [(jenkins-hbase4.apache.org,39271,1689469864817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 01:13:09,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:09,251 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:09,252 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:09,252 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,252 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:09,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:09,255 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 01:13:09,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:09,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 01:13:09,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 01:13:09,255 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 01:13:09,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:09,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:09,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:09,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 01:13:09,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 01:13:09,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 01:13:09,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,307 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689469989140Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689469989251 (+111 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689469989252 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689469989257 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689469989276 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689469989307 (+31 ms) 2023-07-16 01:13:09,311 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 01:13:09,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 169 msec 2023-07-16 01:13:09,444 DEBUG [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 01:13:09,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 01:13:09,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 01:13:09,445 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469989445 2023-07-16 01:13:09,445 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40869, tgtDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469989445, rawTgtDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469989445, srcFsUri=hdfs://localhost:40869, srcDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:13:09,473 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5 2023-07-16 01:13:09,473 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1480204089_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469989445, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469989445/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,473 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40869, inputRoot=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5, snapshotDir=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-16 01:13:09,486 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469989445/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:09,909 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:09,909 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:09,910 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:09,911 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:10,937 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-1092443097777302383.jar 2023-07-16 01:13:10,938 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:10,939 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:11,017 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/hadoop-1250010531463209802.jar 2023-07-16 01:13:11,018 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:11,018 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:11,019 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:11,019 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:11,019 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:11,020 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 01:13:11,020 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 01:13:11,021 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 01:13:11,021 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 01:13:11,022 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 01:13:11,022 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 01:13:11,023 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 01:13:11,023 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 01:13:11,023 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 01:13:11,024 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 01:13:11,025 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 01:13:11,025 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:13:11,026 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:13:11,027 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:13:11,027 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:13:11,028 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 01:13:11,028 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:13:11,029 DEBUG [Listener at jenkins-hbase4.apache.org/39957] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 01:13:12,012 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0006_000001 (auth:SIMPLE) 2023-07-16 01:13:12,061 WARN [Listener at jenkins-hbase4.apache.org/39957] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 01:13:12,064 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-16 01:13:12,067 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-16 01:13:12,236 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:13:12,236 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 01:13:12,830 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0007_000001 (auth:SIMPLE) 2023-07-16 01:13:13,087 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:13:18,761 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0007_000001 (auth:SIMPLE) 2023-07-16 01:13:21,175 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0007_000001 (auth:SIMPLE) 2023-07-16 01:13:24,858 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0007_000001 (auth:SIMPLE) 2023-07-16 01:13:26,456 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 01:13:26,456 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 01:13:26,471 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:26,471 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 01:13:26,472 INFO [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 01:13:26,472 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1398488159_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:26,472 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 01:13:26,472 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 01:13:26,473 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1398488159_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469989445/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469989445/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:26,474 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469989445/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 01:13:26,474 DEBUG [Listener at jenkins-hbase4.apache.org/39957] snapshot.TestExportSnapshot(367): hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/export-test/export-1689469989445/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 01:13:26,502 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:26,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:26,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:26,511 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689470006511"}]},"ts":"1689470006511"} 2023-07-16 01:13:26,513 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-16 01:13:26,515 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-16 01:13:26,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 01:13:26,516 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=39282883deb7db187f42d96fe1ce2241, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94295b6fc0dcc0566c7b5cca1b25dab2, UNASSIGN}] 2023-07-16 01:13:26,518 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=39282883deb7db187f42d96fe1ce2241, UNASSIGN 2023-07-16 01:13:26,521 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94295b6fc0dcc0566c7b5cca1b25dab2, UNASSIGN 2023-07-16 01:13:26,528 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=94295b6fc0dcc0566c7b5cca1b25dab2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:26,528 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=39282883deb7db187f42d96fe1ce2241, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:26,528 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689470006528"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689470006528"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689470006528"}]},"ts":"1689470006528"} 2023-07-16 01:13:26,528 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689470006528"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689470006528"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689470006528"}]},"ts":"1689470006528"} 2023-07-16 01:13:26,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 94295b6fc0dcc0566c7b5cca1b25dab2, server=jenkins-hbase4.apache.org,45775,1689469866515}] 2023-07-16 01:13:26,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 39282883deb7db187f42d96fe1ce2241, server=jenkins-hbase4.apache.org,39681,1689469866446}] 2023-07-16 01:13:26,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 01:13:26,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:26,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:26,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 39282883deb7db187f42d96fe1ce2241, disabling compactions & flushes 2023-07-16 01:13:26,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:26,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:26,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. after waiting 0 ms 2023-07-16 01:13:26,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:26,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 94295b6fc0dcc0566c7b5cca1b25dab2, disabling compactions & flushes 2023-07-16 01:13:26,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:26,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:26,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. after waiting 0 ms 2023-07-16 01:13:26,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:26,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:13:26,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:26,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241. 2023-07-16 01:13:26,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 39282883deb7db187f42d96fe1ce2241: 2023-07-16 01:13:26,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:26,801 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=39282883deb7db187f42d96fe1ce2241, regionState=CLOSED 2023-07-16 01:13:26,801 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689470006801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689470006801"}]},"ts":"1689470006801"} 2023-07-16 01:13:26,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:13:26,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:26,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2. 2023-07-16 01:13:26,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 94295b6fc0dcc0566c7b5cca1b25dab2: 2023-07-16 01:13:26,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:26,812 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-16 01:13:26,812 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 39282883deb7db187f42d96fe1ce2241, server=jenkins-hbase4.apache.org,39681,1689469866446 in 272 msec 2023-07-16 01:13:26,812 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=94295b6fc0dcc0566c7b5cca1b25dab2, regionState=CLOSED 2023-07-16 01:13:26,813 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689470006812"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689470006812"}]},"ts":"1689470006812"} 2023-07-16 01:13:26,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=39282883deb7db187f42d96fe1ce2241, UNASSIGN in 296 msec 2023-07-16 01:13:26,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-16 01:13:26,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 94295b6fc0dcc0566c7b5cca1b25dab2, server=jenkins-hbase4.apache.org,45775,1689469866515 in 284 msec 2023-07-16 01:13:26,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 01:13:26,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-16 01:13:26,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94295b6fc0dcc0566c7b5cca1b25dab2, UNASSIGN in 302 msec 2023-07-16 01:13:26,827 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689470006827"}]},"ts":"1689470006827"} 2023-07-16 01:13:26,831 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-16 01:13:26,838 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-16 01:13:26,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 337 msec 2023-07-16 01:13:27,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 01:13:27,121 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-16 01:13:27,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,132 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,135 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,138 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39681] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,143 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,143 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,143 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,143 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 01:13:27,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 01:13:27,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 01:13:27,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 01:13:27,146 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,146 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,146 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:27,146 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,146 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:27,146 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:27,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 01:13:27,148 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,148 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 01:13:27,151 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:27,151 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:27,154 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/recovered.edits] 2023-07-16 01:13:27,154 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/cf, FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/recovered.edits] 2023-07-16 01:13:27,160 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/cf/f295200c337f492dbccb5c5cee0dba20 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/cf/f295200c337f492dbccb5c5cee0dba20 2023-07-16 01:13:27,164 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/recovered.edits/9.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241/recovered.edits/9.seqid 2023-07-16 01:13:27,165 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/39282883deb7db187f42d96fe1ce2241 2023-07-16 01:13:27,173 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/cf/c8bb1a32380e41178e1ebb58ab533b35 to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/cf/c8bb1a32380e41178e1ebb58ab533b35 2023-07-16 01:13:27,184 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/recovered.edits/9.seqid to hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2/recovered.edits/9.seqid 2023-07-16 01:13:27,184 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94295b6fc0dcc0566c7b5cca1b25dab2 2023-07-16 01:13:27,184 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 01:13:27,188 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,190 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-16 01:13:27,193 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-16 01:13:27,194 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,194 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-16 01:13:27,194 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689470007194"}]},"ts":"9223372036854775807"} 2023-07-16 01:13:27,195 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689470007194"}]},"ts":"9223372036854775807"} 2023-07-16 01:13:27,197 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 01:13:27,197 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 39282883deb7db187f42d96fe1ce2241, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689469987767.39282883deb7db187f42d96fe1ce2241.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 94295b6fc0dcc0566c7b5cca1b25dab2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689469987767.94295b6fc0dcc0566c7b5cca1b25dab2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 01:13:27,197 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-16 01:13:27,197 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689470007197"}]},"ts":"9223372036854775807"} 2023-07-16 01:13:27,206 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-16 01:13:27,209 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 87 msec 2023-07-16 01:13:27,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 01:13:27,253 INFO [Listener at jenkins-hbase4.apache.org/39957] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-16 01:13:27,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 01:13:27,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 01:13:27,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 01:13:27,299 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 765) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:41008 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:59670 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-101507031_1 at /127.0.0.1:59624 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1398488159_17 at /127.0.0.1:58154 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x513c9ae2-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5443 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:34599 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=896 (was 907), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=621 (was 532) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=1247 (was 1729) 2023-07-16 01:13:27,299 WARN [Listener at jenkins-hbase4.apache.org/39957] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-16 01:13:27,299 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-16 01:13:27,329 INFO [Listener at jenkins-hbase4.apache.org/39957] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 01:13:31,045 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689469875738_0007_000001 (auth:SIMPLE) 2023-07-16 01:13:32,373 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 01:13:41,365 INFO [Listener at jenkins-hbase4.apache.org/39957] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 01:13:55,512 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 01:13:55,513 INFO [Listener at jenkins-hbase4.apache.org/39957] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 01:13:55,626 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-16 01:13:55,640 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-16 01:13:55,645 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 01:13:55,693 INFO [Listener at jenkins-hbase4.apache.org/39957] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 01:13:55,699 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 01:13:55,699 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-16 01:13:55,699 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-16 01:13:55,699 INFO [Listener at jenkins-hbase4.apache.org/39957] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-16 01:13:55,699 DEBUG [Listener at jenkins-hbase4.apache.org/39957] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44e82ad3 to 127.0.0.1:64468 2023-07-16 01:13:55,699 DEBUG [Listener at jenkins-hbase4.apache.org/39957] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:55,699 DEBUG [Listener at jenkins-hbase4.apache.org/39957] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-16 01:13:55,700 DEBUG [Listener at jenkins-hbase4.apache.org/39957] util.JVMClusterUtil(257): Found active master hash=328663241, stopped=false 2023-07-16 01:13:55,700 DEBUG [Listener at jenkins-hbase4.apache.org/39957] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:55,700 DEBUG [Listener at jenkins-hbase4.apache.org/39957] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 01:13:55,700 INFO [Listener at jenkins-hbase4.apache.org/39957] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39271,1689469864817 2023-07-16 01:13:55,701 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 01:13:55,701 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 01:13:55,702 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 01:13:55,702 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 01:13:55,702 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:13:55,702 INFO [Listener at jenkins-hbase4.apache.org/39957] procedure2.ProcedureExecutor(629): Stopping 2023-07-16 01:13:55,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:13:55,702 DEBUG [Listener at jenkins-hbase4.apache.org/39957] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36ab921d to 127.0.0.1:64468 2023-07-16 01:13:55,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:13:55,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:13:55,702 DEBUG [Listener at jenkins-hbase4.apache.org/39957] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:55,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 01:13:55,703 INFO [Listener at jenkins-hbase4.apache.org/39957] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39681,1689469866446' ***** 2023-07-16 01:13:55,703 DEBUG [Listener at jenkins-hbase4.apache.org/39957] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:55,704 INFO [Listener at jenkins-hbase4.apache.org/39957] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 01:13:55,704 INFO [Listener at jenkins-hbase4.apache.org/39957] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45775,1689469866515' ***** 2023-07-16 01:13:55,704 DEBUG [Listener at jenkins-hbase4.apache.org/39957] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:55,704 INFO [RS:0;jenkins-hbase4:39681] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 01:13:55,704 INFO [RS:0;jenkins-hbase4:39681] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 01:13:55,704 INFO [RS:0;jenkins-hbase4:39681] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 01:13:55,704 INFO [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(3305): Received CLOSE for 31eeec3d04f822bd09ae6624a8c00b31 2023-07-16 01:13:55,704 INFO [Listener at jenkins-hbase4.apache.org/39957] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 01:13:55,705 INFO [Listener at jenkins-hbase4.apache.org/39957] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41029,1689469866571' ***** 2023-07-16 01:13:55,705 DEBUG [Listener at jenkins-hbase4.apache.org/39957] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:55,705 INFO [Listener at jenkins-hbase4.apache.org/39957] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 01:13:55,705 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 01:13:55,705 INFO [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:55,706 DEBUG [RS:0;jenkins-hbase4:39681] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f3cb92c to 127.0.0.1:64468 2023-07-16 01:13:55,706 DEBUG [RS:0;jenkins-hbase4:39681] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:55,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 31eeec3d04f822bd09ae6624a8c00b31, disabling compactions & flushes 2023-07-16 01:13:55,706 INFO [RS:2;jenkins-hbase4:41029] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 01:13:55,707 INFO [RS:2;jenkins-hbase4:41029] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 01:13:55,708 INFO [RS:2;jenkins-hbase4:41029] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 01:13:55,708 INFO [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(3305): Received CLOSE for dfd0e3c73b9b0359a47f8799cf573d4c 2023-07-16 01:13:55,708 INFO [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:55,708 DEBUG [RS:2;jenkins-hbase4:41029] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47ff91de to 127.0.0.1:64468 2023-07-16 01:13:55,708 DEBUG [RS:2;jenkins-hbase4:41029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:55,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. 2023-07-16 01:13:55,706 INFO [RS:1;jenkins-hbase4:45775] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 01:13:55,710 INFO [RS:1;jenkins-hbase4:45775] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 01:13:55,710 INFO [RS:1;jenkins-hbase4:45775] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 01:13:55,710 INFO [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:55,710 DEBUG [RS:1;jenkins-hbase4:45775] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x588b8164 to 127.0.0.1:64468 2023-07-16 01:13:55,710 DEBUG [RS:1;jenkins-hbase4:45775] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:55,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. 2023-07-16 01:13:55,707 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 01:13:55,711 INFO [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 01:13:55,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. after waiting 0 ms 2023-07-16 01:13:55,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dfd0e3c73b9b0359a47f8799cf573d4c, disabling compactions & flushes 2023-07-16 01:13:55,710 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 01:13:55,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. 2023-07-16 01:13:55,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. 2023-07-16 01:13:55,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 31eeec3d04f822bd09ae6624a8c00b31 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-16 01:13:55,711 DEBUG [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(1478): Online Regions={31eeec3d04f822bd09ae6624a8c00b31=hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31.} 2023-07-16 01:13:55,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. 2023-07-16 01:13:55,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. after waiting 0 ms 2023-07-16 01:13:55,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. 2023-07-16 01:13:55,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing dfd0e3c73b9b0359a47f8799cf573d4c 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-16 01:13:55,714 DEBUG [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(1504): Waiting on 31eeec3d04f822bd09ae6624a8c00b31 2023-07-16 01:13:55,718 INFO [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 01:13:55,718 DEBUG [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(1478): Online Regions={dfd0e3c73b9b0359a47f8799cf573d4c=hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c.} 2023-07-16 01:13:55,718 DEBUG [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(1504): Waiting on dfd0e3c73b9b0359a47f8799cf573d4c 2023-07-16 01:13:55,718 INFO [RS:1;jenkins-hbase4:45775] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 01:13:55,718 INFO [RS:1;jenkins-hbase4:45775] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 01:13:55,718 INFO [RS:1;jenkins-hbase4:45775] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 01:13:55,718 INFO [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-16 01:13:55,730 INFO [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 01:13:55,731 DEBUG [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-16 01:13:55,731 DEBUG [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-16 01:13:55,734 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 01:13:55,735 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 01:13:55,735 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 01:13:55,735 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 01:13:55,735 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 01:13:55,736 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-16 01:13:55,743 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 01:13:55,755 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 01:13:55,755 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 01:13:55,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c/.tmp/info/a4d00098872f4ff1b77edd6eeb7917dc 2023-07-16 01:13:55,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31/.tmp/l/1d6daa49287a4bbd87dde261b7912159 2023-07-16 01:13:55,863 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/.tmp/info/e4429471261c4afabfb484a7339e71e2 2023-07-16 01:13:55,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d6daa49287a4bbd87dde261b7912159 2023-07-16 01:13:55,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31/.tmp/l/1d6daa49287a4bbd87dde261b7912159 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31/l/1d6daa49287a4bbd87dde261b7912159 2023-07-16 01:13:55,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c/.tmp/info/a4d00098872f4ff1b77edd6eeb7917dc as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c/info/a4d00098872f4ff1b77edd6eeb7917dc 2023-07-16 01:13:55,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d6daa49287a4bbd87dde261b7912159 2023-07-16 01:13:55,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31/l/1d6daa49287a4bbd87dde261b7912159, entries=7, sequenceid=18, filesize=5.2 K 2023-07-16 01:13:55,874 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4429471261c4afabfb484a7339e71e2 2023-07-16 01:13:55,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 31eeec3d04f822bd09ae6624a8c00b31 in 162ms, sequenceid=18, compaction requested=false 2023-07-16 01:13:55,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c/info/a4d00098872f4ff1b77edd6eeb7917dc, entries=2, sequenceid=6, filesize=4.8 K 2023-07-16 01:13:55,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for dfd0e3c73b9b0359a47f8799cf573d4c in 166ms, sequenceid=6, compaction requested=false 2023-07-16 01:13:55,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/namespace/dfd0e3c73b9b0359a47f8799cf573d4c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 01:13:55,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:55,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. 2023-07-16 01:13:55,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dfd0e3c73b9b0359a47f8799cf573d4c: 2023-07-16 01:13:55,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689469869522.dfd0e3c73b9b0359a47f8799cf573d4c. 2023-07-16 01:13:55,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/acl/31eeec3d04f822bd09ae6624a8c00b31/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-16 01:13:55,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:55,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. 2023-07-16 01:13:55,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 31eeec3d04f822bd09ae6624a8c00b31: 2023-07-16 01:13:55,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689469870279.31eeec3d04f822bd09ae6624a8c00b31. 2023-07-16 01:13:55,914 INFO [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39681,1689469866446; all regions closed. 2023-07-16 01:13:55,916 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/.tmp/rep_barrier/193ee2bfb4014125ad68729b9c59a2d3 2023-07-16 01:13:55,918 INFO [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41029,1689469866571; all regions closed. 2023-07-16 01:13:55,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 193ee2bfb4014125ad68729b9c59a2d3 2023-07-16 01:13:55,931 DEBUG [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-16 01:13:55,960 DEBUG [RS:0;jenkins-hbase4:39681] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/oldWALs 2023-07-16 01:13:55,960 INFO [RS:0;jenkins-hbase4:39681] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39681%2C1689469866446:(num 1689469868791) 2023-07-16 01:13:55,960 DEBUG [RS:0;jenkins-hbase4:39681] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:55,960 INFO [RS:0;jenkins-hbase4:39681] regionserver.LeaseManager(133): Closed leases 2023-07-16 01:13:55,968 DEBUG [RS:2;jenkins-hbase4:41029] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/oldWALs 2023-07-16 01:13:55,969 INFO [RS:2;jenkins-hbase4:41029] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41029%2C1689469866571:(num 1689469868791) 2023-07-16 01:13:55,969 DEBUG [RS:2;jenkins-hbase4:41029] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:55,969 INFO [RS:2;jenkins-hbase4:41029] regionserver.LeaseManager(133): Closed leases 2023-07-16 01:13:55,971 INFO [RS:0;jenkins-hbase4:39681] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-16 01:13:55,971 INFO [RS:2;jenkins-hbase4:41029] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 01:13:55,971 INFO [RS:0;jenkins-hbase4:39681] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 01:13:55,972 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 01:13:55,972 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 01:13:55,972 INFO [RS:2;jenkins-hbase4:41029] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 01:13:55,972 INFO [RS:0;jenkins-hbase4:39681] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 01:13:55,972 INFO [RS:2;jenkins-hbase4:41029] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 01:13:55,973 INFO [RS:2;jenkins-hbase4:41029] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 01:13:55,972 INFO [RS:0;jenkins-hbase4:39681] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 01:13:55,974 INFO [RS:2;jenkins-hbase4:41029] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41029 2023-07-16 01:13:55,980 INFO [RS:0;jenkins-hbase4:39681] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39681 2023-07-16 01:13:55,980 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:55,980 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:55,981 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:13:55,981 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:13:55,981 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41029,1689469866571 2023-07-16 01:13:55,981 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:13:55,981 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:13:55,983 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:55,983 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:55,983 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39681,1689469866446 2023-07-16 01:13:55,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/.tmp/table/7b659888c2c74ddd9ef0e9a77c163576 2023-07-16 01:13:55,991 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b659888c2c74ddd9ef0e9a77c163576 2023-07-16 01:13:55,991 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39681,1689469866446] 2023-07-16 01:13:55,992 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39681,1689469866446; numProcessing=1 2023-07-16 01:13:55,992 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/.tmp/info/e4429471261c4afabfb484a7339e71e2 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/info/e4429471261c4afabfb484a7339e71e2 2023-07-16 01:13:55,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4429471261c4afabfb484a7339e71e2 2023-07-16 01:13:55,999 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/info/e4429471261c4afabfb484a7339e71e2, entries=48, sequenceid=131, filesize=10.3 K 2023-07-16 01:13:56,000 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/.tmp/rep_barrier/193ee2bfb4014125ad68729b9c59a2d3 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/rep_barrier/193ee2bfb4014125ad68729b9c59a2d3 2023-07-16 01:13:56,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 193ee2bfb4014125ad68729b9c59a2d3 2023-07-16 01:13:56,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/rep_barrier/193ee2bfb4014125ad68729b9c59a2d3, entries=13, sequenceid=131, filesize=6.4 K 2023-07-16 01:13:56,015 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/.tmp/table/7b659888c2c74ddd9ef0e9a77c163576 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/table/7b659888c2c74ddd9ef0e9a77c163576 2023-07-16 01:13:56,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b659888c2c74ddd9ef0e9a77c163576 2023-07-16 01:13:56,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/table/7b659888c2c74ddd9ef0e9a77c163576, entries=24, sequenceid=131, filesize=6.9 K 2023-07-16 01:13:56,021 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 286ms, sequenceid=131, compaction requested=false 2023-07-16 01:13:56,032 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-16 01:13:56,033 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 01:13:56,033 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 01:13:56,034 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 01:13:56,034 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 01:13:56,034 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-16 01:13:56,088 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:56,088 INFO [RS:2;jenkins-hbase4:41029] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41029,1689469866571; zookeeper connection closed. 2023-07-16 01:13:56,088 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:41029-0x1016baeca7e0003, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:56,089 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@418c96a1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@418c96a1 2023-07-16 01:13:56,089 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39681,1689469866446 already deleted, retry=false 2023-07-16 01:13:56,089 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39681,1689469866446 expired; onlineServers=2 2023-07-16 01:13:56,089 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41029,1689469866571] 2023-07-16 01:13:56,089 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41029,1689469866571; numProcessing=2 2023-07-16 01:13:56,131 INFO [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45775,1689469866515; all regions closed. 2023-07-16 01:13:56,143 DEBUG [RS:1;jenkins-hbase4:45775] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/oldWALs 2023-07-16 01:13:56,143 INFO [RS:1;jenkins-hbase4:45775] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45775%2C1689469866515.meta:.meta(num 1689469869110) 2023-07-16 01:13:56,160 DEBUG [RS:1;jenkins-hbase4:45775] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/oldWALs 2023-07-16 01:13:56,161 INFO [RS:1;jenkins-hbase4:45775] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45775%2C1689469866515:(num 1689469868791) 2023-07-16 01:13:56,161 DEBUG [RS:1;jenkins-hbase4:45775] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:56,161 INFO [RS:1;jenkins-hbase4:45775] regionserver.LeaseManager(133): Closed leases 2023-07-16 01:13:56,161 INFO [RS:1;jenkins-hbase4:45775] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-16 01:13:56,161 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 01:13:56,162 INFO [RS:1;jenkins-hbase4:45775] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45775 2023-07-16 01:13:56,188 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:56,188 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:39681-0x1016baeca7e0001, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:56,188 INFO [RS:0;jenkins-hbase4:39681] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39681,1689469866446; zookeeper connection closed. 2023-07-16 01:13:56,189 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5c436ffa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5c436ffa 2023-07-16 01:13:56,192 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45775,1689469866515 2023-07-16 01:13:56,192 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 01:13:56,193 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41029,1689469866571 already deleted, retry=false 2023-07-16 01:13:56,193 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41029,1689469866571 expired; onlineServers=1 2023-07-16 01:13:56,195 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45775,1689469866515] 2023-07-16 01:13:56,196 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45775,1689469866515; numProcessing=3 2023-07-16 01:13:56,296 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:56,296 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): regionserver:45775-0x1016baeca7e0002, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:56,296 INFO [RS:1;jenkins-hbase4:45775] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45775,1689469866515; zookeeper connection closed. 2023-07-16 01:13:56,296 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@439f46aa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@439f46aa 2023-07-16 01:13:56,296 INFO [Listener at jenkins-hbase4.apache.org/39957] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-16 01:13:56,297 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45775,1689469866515 already deleted, retry=false 2023-07-16 01:13:56,297 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45775,1689469866515 expired; onlineServers=0 2023-07-16 01:13:56,297 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39271,1689469864817' ***** 2023-07-16 01:13:56,297 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-16 01:13:56,297 DEBUG [M:0;jenkins-hbase4:39271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52aa0af2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 01:13:56,297 INFO [M:0;jenkins-hbase4:39271] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39271,1689469864817 2023-07-16 01:13:56,297 INFO [M:0;jenkins-hbase4:39271] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39271,1689469864817; all regions closed. 2023-07-16 01:13:56,297 DEBUG [M:0;jenkins-hbase4:39271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 01:13:56,297 DEBUG [M:0;jenkins-hbase4:39271] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-16 01:13:56,297 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-16 01:13:56,298 DEBUG [M:0;jenkins-hbase4:39271] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-16 01:13:56,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689469868299] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689469868299,5,FailOnTimeoutGroup] 2023-07-16 01:13:56,298 INFO [M:0;jenkins-hbase4:39271] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-16 01:13:56,298 INFO [M:0;jenkins-hbase4:39271] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-16 01:13:56,298 INFO [M:0;jenkins-hbase4:39271] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-16 01:13:56,298 DEBUG [M:0;jenkins-hbase4:39271] master.HMaster(1512): Stopping service threads 2023-07-16 01:13:56,298 INFO [M:0;jenkins-hbase4:39271] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-16 01:13:56,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689469868294] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689469868294,5,FailOnTimeoutGroup] 2023-07-16 01:13:56,299 ERROR [M:0;jenkins-hbase4:39271] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-16 01:13:56,299 INFO [M:0;jenkins-hbase4:39271] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-16 01:13:56,299 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-16 01:13:56,300 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-16 01:13:56,300 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 01:13:56,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 01:13:56,300 DEBUG [M:0;jenkins-hbase4:39271] zookeeper.ZKUtil(398): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-16 01:13:56,301 WARN [M:0;jenkins-hbase4:39271] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-16 01:13:56,301 INFO [M:0;jenkins-hbase4:39271] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-16 01:13:56,301 INFO [M:0;jenkins-hbase4:39271] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-16 01:13:56,302 DEBUG [M:0;jenkins-hbase4:39271] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 01:13:56,302 INFO [M:0;jenkins-hbase4:39271] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:13:56,302 DEBUG [M:0;jenkins-hbase4:39271] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:13:56,302 DEBUG [M:0;jenkins-hbase4:39271] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 01:13:56,302 DEBUG [M:0;jenkins-hbase4:39271] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:13:56,302 INFO [M:0;jenkins-hbase4:39271] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.34 KB heapSize=449.55 KB 2023-07-16 01:13:56,336 INFO [M:0;jenkins-hbase4:39271] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.34 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bbfcc7e15b4b458c92f10848abe91056 2023-07-16 01:13:56,340 INFO [M:0;jenkins-hbase4:39271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bbfcc7e15b4b458c92f10848abe91056 2023-07-16 01:13:56,340 DEBUG [M:0;jenkins-hbase4:39271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bbfcc7e15b4b458c92f10848abe91056 as hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bbfcc7e15b4b458c92f10848abe91056 2023-07-16 01:13:56,344 INFO [M:0;jenkins-hbase4:39271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bbfcc7e15b4b458c92f10848abe91056 2023-07-16 01:13:56,345 INFO [M:0;jenkins-hbase4:39271] regionserver.HStore(1080): Added hdfs://localhost:40869/user/jenkins/test-data/465e69b0-2d73-e775-d7d2-7f2c6e0dc8a5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bbfcc7e15b4b458c92f10848abe91056, entries=119, sequenceid=899, filesize=28.4 K 2023-07-16 01:13:56,345 INFO [M:0;jenkins-hbase4:39271] regionserver.HRegion(2948): Finished flush of dataSize ~373.34 KB/382298, heapSize ~449.54 KB/460328, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 43ms, sequenceid=899, compaction requested=false 2023-07-16 01:13:56,347 INFO [M:0;jenkins-hbase4:39271] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 01:13:56,347 DEBUG [M:0;jenkins-hbase4:39271] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 01:13:56,352 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 01:13:56,352 INFO [M:0;jenkins-hbase4:39271] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-16 01:13:56,353 INFO [M:0;jenkins-hbase4:39271] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39271 2023-07-16 01:13:56,355 DEBUG [M:0;jenkins-hbase4:39271] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39271,1689469864817 already deleted, retry=false 2023-07-16 01:13:56,457 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:56,457 INFO [M:0;jenkins-hbase4:39271] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39271,1689469864817; zookeeper connection closed. 2023-07-16 01:13:56,458 DEBUG [Listener at localhost/33183-EventThread] zookeeper.ZKWatcher(600): master:39271-0x1016baeca7e0000, quorum=127.0.0.1:64468, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 01:13:56,460 WARN [Listener at jenkins-hbase4.apache.org/39957] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 01:13:56,493 INFO [Listener at jenkins-hbase4.apache.org/39957] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 01:13:56,598 WARN [BP-1308403848-172.31.14.131-1689469860362 heartbeating to localhost/127.0.0.1:40869] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 01:13:56,598 WARN [BP-1308403848-172.31.14.131-1689469860362 heartbeating to localhost/127.0.0.1:40869] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1308403848-172.31.14.131-1689469860362 (Datanode Uuid a8962899-e062-45d7-9d32-941072eb2f03) service to localhost/127.0.0.1:40869 2023-07-16 01:13:56,600 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/dfs/data/data5/current/BP-1308403848-172.31.14.131-1689469860362] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 01:13:56,600 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/dfs/data/data6/current/BP-1308403848-172.31.14.131-1689469860362] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 01:13:56,602 WARN [Listener at jenkins-hbase4.apache.org/39957] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 01:13:56,605 INFO [Listener at jenkins-hbase4.apache.org/39957] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 01:13:56,708 WARN [BP-1308403848-172.31.14.131-1689469860362 heartbeating to localhost/127.0.0.1:40869] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 01:13:56,708 WARN [BP-1308403848-172.31.14.131-1689469860362 heartbeating to localhost/127.0.0.1:40869] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1308403848-172.31.14.131-1689469860362 (Datanode Uuid 88d35cd8-1f10-4ebb-8af2-128649e2b955) service to localhost/127.0.0.1:40869 2023-07-16 01:13:56,709 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/dfs/data/data3/current/BP-1308403848-172.31.14.131-1689469860362] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 01:13:56,709 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/dfs/data/data4/current/BP-1308403848-172.31.14.131-1689469860362] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 01:13:56,711 WARN [Listener at jenkins-hbase4.apache.org/39957] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 01:13:56,715 INFO [Listener at jenkins-hbase4.apache.org/39957] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 01:13:56,818 WARN [BP-1308403848-172.31.14.131-1689469860362 heartbeating to localhost/127.0.0.1:40869] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 01:13:56,819 WARN [BP-1308403848-172.31.14.131-1689469860362 heartbeating to localhost/127.0.0.1:40869] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1308403848-172.31.14.131-1689469860362 (Datanode Uuid 187cf807-9cbb-43d8-b085-99b26a17cfcd) service to localhost/127.0.0.1:40869 2023-07-16 01:13:56,819 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/dfs/data/data1/current/BP-1308403848-172.31.14.131-1689469860362] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 01:13:56,820 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/30011287-d732-6ff9-dc17-e06819b24c0b/cluster_728ed47d-ef2e-262c-0c19-566572d83cf9/dfs/data/data2/current/BP-1308403848-172.31.14.131-1689469860362] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 01:13:56,842 INFO [Listener at jenkins-hbase4.apache.org/39957] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 01:13:56,970 INFO [Listener at jenkins-hbase4.apache.org/39957] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-16 01:13:57,079 INFO [Listener at jenkins-hbase4.apache.org/39957] hbase.HBaseTestingUtility(1293): Minicluster is down